00000001:02000400:1.0F:1789517987.615555:0:2955:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1789517999.051217:0:3158:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1789518000.287053:0:3220:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 759 MB/s 00000001:01000000:2.0:1789518000.537195:0:3220:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1031 MB/s 00000001:01000000:1.0:1789518000.786704:0:3220:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 7559 MB/s 00000020:02000000:3.0:1789518001.150942:0:3249:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_g97904ba 00000400:02000000:0.0F:1789518001.619477:0:3264:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.206.151@tcp [8/256/0/180] 00008000:02000000:3.0:1789518004.363741:0:3413:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1789518033.396039:0:5220:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789518038.391295:0:5793:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789518038.391301:0:5793:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1789518038.391400:0:5793:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000000bdee76b 00000080:02000400:1.0:1789518038.391412:0:5793:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1789518038.395941:0:5793:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1789518038.395953:0:5793:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789518038.395987:0:5793:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000002fbcffed) 00000020:00000080:1.0:1789518038.396005:0:5793:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789518038.415929:0:5793:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1789518038.416431:0:5793:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1789518038.436997:0:5793:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1789518038.437029:0:5793:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789518038.437046:0:5793:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1789518038.437088:0:5793:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789518038.437108:0:5793:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1789518038.437438:0:5793:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1789518038.437445:0:5793:0:(osd_handler.c:1614:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789518038.437453:0:5793:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c780922 00000020:01000004:1.0:1789518038.437460:0:5793:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1789518038.437464:0:5793:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1789518038.437468:0:5793:0:(tgt_mount.c:101:server_register_mount()) register mount 000000000bdee76b from MGS 00000020:01000004:1.0:1789518038.437472:0:5793:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1789518038.437715:0:5793:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000349339e3) 00000020:00000080:1.0:1789518038.437725:0:5793:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1789518038.437769:0:5793:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000bdee76b from MGS, refs=2 00080000:01000000:1.0:1789518038.437773:0:5793:0:(osd_handler.c:1614:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789518038.437778:0:5793:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c780930 00000100:00100000:1.0:1789518038.437862:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1789518038.437979:0:5793:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1789518038.437984:0:5793:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1789518038.439838:0:5793:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1789518038.439853:0:5793:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789518038.440550:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789518038.440820:0:5793:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789518038.440826:0:5793:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789518038.441497:0:5793:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789518038.441505:0:5793:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789518038.441966:0:5793:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789518038.441973:0:5793:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789518038.442558:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518038.442561:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518038.442562:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518038.443093:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518038.443096:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518038.443097:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518038.443553:0:5793:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789518038.449468:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1789518038.692848:0:5793:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 5347 MB/s 00000001:01000000:3.0:1789518038.942711:0:5793:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 5935 MB/s 00000001:01000000:3.0:1789518039.192743:0:5793:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1127 MB/s 00000001:01000000:3.0:1789518039.442993:0:5793:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1603 MB/s 00080000:10000000:3.0:1789518039.448075:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:3.0:1789518039.455759:0:5793:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1789518039.455773:0:5793:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789518039.455776:0:5793:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1789518039.456373:0:5803:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789518039.456409:0:5793:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789518039.456451:0:5793:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1789518039.456678:0:5793:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789518039.456702:0:5793:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789518039.457039:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789518039.457242:0:5793:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789518039.457249:0:5793:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789518039.458754:0:5793:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789518039.458764:0:5793:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789518039.459132:0:5793:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789518039.459136:0:5793:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:1.0:1789518039.459591:0:5808:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1789518039.459663:0:5793:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789518039.459683:0:5793:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.151@tcp' 00000020:01000004:3.0:1789518039.459685:0:5793:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789518039.459733:0:5793:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.151@tcp (typ=mgc) 00000020:00000080:3.0:1789518039.459748:0:5793:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.151@tcp (0000000057a2fc7d) 00000020:00000080:3.0:1789518039.459779:0:5793:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789518039.459921:0:5793:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004209cf92@MGC192.168.206.151@tcp: add connection 192.168.206.151@tcp at head 00010000:00010000:3.0:1789518039.460095:0:5793:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.151@tcp-0 is initialized 00000040:01000000:3.0:1789518039.460101:0:5793:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 1 is initialized 10000000:01000000:0.0:1789518039.461444:0:5810:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789518039.461511:0:5793:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.151@tcp (uuid 824c8f07-28fa-48fd-81af-173b194570e6) 00000020:00000080:0.0:1789518039.461532:0:5793:0:(genops.c:1384:class_connect()) connect: client 824c8f07-28fa-48fd-81af-173b194570e6, cookie 0x631fd8698c78093e 00000100:00080000:0.0:1789518039.461544:0:5793:0:(import.c:545:import_select_connection()) MGC192.168.206.151@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789518039.461551:0:5793:0:(import.c:666:import_select_connection()) MGC192.168.206.151@tcp: import 000000004209cf92 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1789518039.461678:0:5793:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004bb3a93b x1876445627416704/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789518039.461708:0:5793:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 824c8f07-28fa-48fd-81af-173b194570e6->MGS 00000020:01000004:0.0:1789518039.461730:0:5793:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789518039.461735:0:5793:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789518039.461758:0:5793:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000003523dda1) 00000020:00000080:0.0:1789518039.461770:0:5793:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789518039.461863:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004bb3a93b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:824c8f07-28fa-48fd-81af-173b194570e6:3279:1876445627416704:0@lo:250: 00000100:00100000:2.0:1789518039.461921:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518039.461989:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627416704 00000100:00100000:2.0:1789518039.461996:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627416704 00000100:00100000:2.0:1789518039.462028:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789518039.462034:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004e0d6abd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3279:x1876445627416704:12345-0@lo:250: 00010000:00080000:2.0:1789518039.462052:0:5805:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 824c8f07-28fa-48fd-81af-173b194570e6@0@lo t0 exp 0000000000000000 cur 93 last 0 00000020:00000080:2.0:1789518039.462078:0:5805:0:(genops.c:1384:class_connect()) connect: client 824c8f07-28fa-48fd-81af-173b194570e6, cookie 0x631fd8698c78094c 00000100:00080000:2.0:1789518039.462230:0:5805:0:(import.c:65:import_set_state_nolock()) 000000002dd43e20 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789518039.462272:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004e0d6abd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+5:3279:x1876445627416704:12345-0@lo:250: Request processed in 238us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518039.462279:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789518039.462319:0:3279:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.151@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1789518039.462326:0:3279:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.206.151@tcp: connect to target with instance 0 00000100:00080000:2.0:1789518039.462331:0:3279:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.206.151@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1789518039.462334:0:3279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1789518039.462337:0:3279:0:(import.c:65:import_set_state_nolock()) 000000004209cf92 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1789518039.462339:0:3279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1789518039.462346:0:3279:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1789518039.462350:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004bb3a93b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:824c8f07-28fa-48fd-81af-173b194570e6:3279:1876445627416704:0@lo:250: 00000100:00100000:0.0:1789518039.467440:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789518039.467660:0:5793:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789518039.467667:0:5793:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789518039.468556:0:5793:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789518039.468564:0:5793:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789518039.468962:0:5793:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789518039.468968:0:5793:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789518039.469876:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789518039.470046:0:5793:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789518039.470052:0:5793:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789518039.470648:0:5793:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789518039.470656:0:5793:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00010000:00010000:0.0:1789518039.474954:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518039.491894:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789518039.492109:0:5793:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789518039.492115:0:5793:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789518039.492870:0:5793:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789518039.492878:0:5793:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789518039.493288:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789518039.493452:0:5793:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789518039.493455:0:5793:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789518039.493778:0:5793:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789518039.493783:0:5793:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789518039.494578:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789518039.494810:0:5793:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789518039.494813:0:5793:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789518039.495155:0:5793:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789518039.495162:0:5793:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789518039.495780:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789518039.495895:0:5793:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789518039.495900:0:5793:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789518039.496238:0:5793:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789518039.496245:0:5793:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789518039.511454:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789518039.511706:0:5793:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789518039.511712:0:5793:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789518039.512826:0:5793:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789518039.512835:0:5793:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789518039.515515:0:5793:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789518039.515528:0:5793:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789518039.516503:0:5793:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789518039.516524:0:5793:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1789518039.516529:0:5793:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.151@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789518039.516766:0:5793:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789518039.516802:0:5793:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.151@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1789518039.516806:0:5793:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789518039.516807:0:5793:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789518039.516809:0:5793:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518039.516810:0:5793:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518039.516811:0:5793:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518039.516812:0:5793:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518039.516813:0:5793:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789518039.516815:0:5793:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789518039.516816:0:5793:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789518039.516817:0:5793:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789518039.516818:0:5793:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518039.516819:0:5793:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789518039.516821:0:5793:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1789518039.516824:0:5793:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789518039.516825:0:5793:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789518039.516826:0:5793:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518039.516827:0:5793:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518039.516828:0:5793:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518039.516829:0:5793:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518039.516830:0:5793:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789518039.516834:0:5793:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789518039.516835:0:5793:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789518039.516836:0:5793:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789518039.516837:0:5793:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518039.516838:0:5793:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789518039.517516:0:5793:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789518039.517532:0:5793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ad8daf4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:5793:1876445627416832:0@lo:253: 00000100:00100000:1.0:1789518039.517592:0:5793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518039.517801:0:5793:0:(client.c:2716:ptlrpc_set_wait()) set 000000009fcb4ebb going to sleep for 11 seconds 00000100:00100000:2.0:1789518039.518245:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627416832 00000100:00100000:2.0:1789518039.518253:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627416832 00000100:00100000:2.0:1789518039.518329:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789518039.518346:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000dd65d7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+5:5793:x1876445627416832:12345-0@lo:253: 20000000:01000000:2.0:1789518039.518386:0:5807:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789518039.518389:0:5807:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1789518039.518706:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789518039.518764:0:5807:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1789518039.518985:0:5807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789518039.519995:0:5828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1789518039.520129:0:5807:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789518039.520132:0:5807:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1789518039.520261:0:5807:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1789518039.520264:0:5807:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1789518039.520289:0:5807:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1789518039.520426:0:5807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789518039.520692:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1789518039.520704:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789518039.520749:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1789518039.520814:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1789518039.520854:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1789518039.520938:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1789518039.520946:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1789518039.520988:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1789518039.520995:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1789518039.521016:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1789518039.521019:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1789518039.521035:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1789518039.521060:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1789518039.521077:0:5807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789518039.521080:0:5807:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1789518039.521091:0:5807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789518039.521399:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1789518039.521410:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789518039.521439:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1789518039.521457:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1789518039.521510:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1789518039.521522:0:5807:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1789518039.521585:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1789518039.521591:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789518039.521661:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1789518039.521700:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1789518039.521737:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1789518039.521748:0:5807:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1789518039.521843:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1789518039.521853:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1789518039.521901:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1789518039.521936:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1789518039.522088:0:5807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1789518039.522117:0:5807:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1789518039.522121:0:5807:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1789518039.522547:0:5829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1789518039.522874:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1789518039.522893:0:5807:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.151@tcp for mdt 20000000:01000000:3.0:1789518039.522894:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.151@tcp (null) (null) (null) 00000040:00080000:3.0:1789518039.522927:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1789518039.522934:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789518039.522976:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1789518039.522988:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.151@tcp (null) (null) 00000040:00080000:3.0:1789518039.523026:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1789518039.523033:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1789518039.523050:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1789518039.523067:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1789518039.523122:0:5807:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789518039.523126:0:5807:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789518039.523131:0:5807:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1789518039.523136:0:5807:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1789518039.524463:0:5830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:3.0:1789518039.524965:0:5807:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1789518039.534401:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1789518039.534444:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1789518039.534521:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1789518039.534538:0:5807:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789518039.534541:0:5807:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789518039.534544:0:5807:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789518039.534556:0:5807:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789518039.534558:0:5807:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789518039.534584:0:5807:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789518039.534586:0:5807:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789518039.536708:0:5831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1789518039.537196:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1789518039.537226:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1789518039.537243:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1789518039.537250:0:5807:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789518039.537252:0:5807:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789518039.538423:0:5832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:3.0:1789518039.538675:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:3.0:1789518039.538884:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:3.0:1789518039.538992:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:3.0:1789518039.539010:0:5807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789518039.539013:0:5807:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:3.0:1789518039.539030:0:5807:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789518039.539050:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000078dfac31/0x631fd8698c780953 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518039.539065:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000078dfac31/0x631fd8698c780953 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518039.539075:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000078dfac31/0x631fd8698c780953 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518039.539082:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000078dfac31/0x631fd8698c780953 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518039.539089:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000078dfac31/0x631fd8698c780953 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518039.539096:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000078dfac31/0x631fd8698c780953 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518039.539103:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000078dfac31 already unused, calling callback (0000000005329a85) 00010000:00010000:3.0:1789518039.539106:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000078dfac31/0x631fd8698c780953 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518039.539114:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000078dfac31/0x631fd8698c780953 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518039.539127:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000078dfac31/0x631fd8698c780953 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518039.539134:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000078dfac31/0x631fd8698c780953 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518039.539140:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000078dfac31/0x631fd8698c780953 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789518039.539165:0:5807:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789518039.668462:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000dd65d7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+5:5793:x1876445627416832:12345-0@lo:253: Request processed in 150113us (150865us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518039.668476:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789518039.668513:0:5793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ad8daf4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:5793:1876445627416832:0@lo:253: 10000000:01000000:0.0:1789518039.668531:0:5793:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789518039.668534:0:5793:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789518039.668536:0:5793:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789518039.668538:0:5793:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789518039.668539:0:5793:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1789518039.668540:0:5793:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789518039.668541:0:5793:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789518039.668542:0:5793:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789518039.668544:0:5793:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789518039.668545:0:5793:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789518039.668547:0:5793:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789518039.668548:0:5793:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789518039.668565:0:5793:0:(tgt_mount.c:101:server_register_mount()) register mount 000000000bdee76b from lustre-MDT0000 10000000:01000000:0.0:1789518039.668665:0:5793:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789518039.668668:0:5793:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789518039.668671:0:5793:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff99ffc64a4d40 10000000:01000000:0.0:1789518039.668674:0:5793:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789518039.668680:0:5793:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99ffc64a4d40 from 1 10000000:01000000:0.0:1789518039.668682:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789518039.668707:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: 00000000c8837bac/0x631fd8698c78095a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518039.668714:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: 00000000c8837bac/0x631fd8698c78095a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518039.668736:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: 00000000c8837bac/0x631fd8698c78095a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518039.668748:0:5793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000daef77f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:5793:1876445627416960:0@lo:101: 00000100:00100000:0.0:1789518039.668801:0:5793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518039.668862:0:5793:0:(client.c:2716:ptlrpc_set_wait()) set 000000009e50f187 going to sleep for 11 seconds 00000100:00100000:2.0:1789518039.668935:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627416960 00000100:00100000:2.0:1789518039.668942:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627416960 00000100:00100000:2.0:1789518039.668980:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789518039.668988:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000339e154c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+5:5793:x1876445627416960:12345-0@lo:101: 00010000:00010000:2.0:1789518039.669000:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518039.669012:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000df0eeec/0x631fd8698c780961 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c78095a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518039.669032:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000df0eeec/0x631fd8698c780961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c78095a expref: 6 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518039.669042:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000df0eeec/0x631fd8698c780961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c78095a expref: 6 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518039.669049:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000df0eeec, rc 0) 00000100:00100000:2.0:1789518039.669079:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000339e154c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+6:5793:x1876445627416960:12345-0@lo:101: Request processed in 92us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518039.669083:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789518039.669137:0:5793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000daef77f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:5793:1876445627416960:0@lo:101: 00010000:00010000:0.0:1789518039.669148:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: 00000000c8837bac/0x631fd8698c78095a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780961 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518039.669156:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: 00000000c8837bac/0x631fd8698c78095a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780961 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518039.669192:0:5793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000daef77f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:5793:1876445627417088:0@lo:501: 00000100:00100000:0.0:1789518039.669263:0:5793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518039.669333:0:5793:0:(client.c:2716:ptlrpc_set_wait()) set 000000009e50f187 going to sleep for 11 seconds 00000100:00100000:1.0:1789518039.669367:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627417088 00000100:00100000:1.0:1789518039.669372:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627417088 00000100:00100000:1.0:1789518039.669402:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789518039.669409:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e21b0bbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+6:5793:x1876445627417088:12345-0@lo:501: 00000100:00100000:1.0:1789518039.669669:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e21b0bbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+6:5793:x1876445627417088:12345-0@lo:501: Request processed in 261us (405us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789518039.669674:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789518039.669753:0:5793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000daef77f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:5793:1876445627417088:0@lo:501: 10000000:01000000:0.0:1789518039.669776:0:5793:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789518039.669794:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: 00000000c8837bac/0x631fd8698c78095a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780961 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518039.669803:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: 00000000c8837bac/0x631fd8698c78095a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780961 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518039.669809:0:5793:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99ffc84db000 10000000:01000000:0.0:1789518039.669813:0:5793:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789518039.669822:0:5793:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99ffc84db000 10000000:01000000:0.0:1789518039.669825:0:5793:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789518039.669827:0:5793:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff99ffc84db000 from 1 10000000:01000000:0.0:1789518039.669829:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789518039.669844:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: 00000000740fc4ab/0x631fd8698c780968 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518039.669850:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: 00000000740fc4ab/0x631fd8698c780968 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518039.669857:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: 00000000740fc4ab/0x631fd8698c780968 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518039.669868:0:5793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000daef77f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:5793:1876445627417216:0@lo:101: 00000100:00100000:0.0:1789518039.669897:0:5793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518039.669921:0:5793:0:(client.c:2716:ptlrpc_set_wait()) set 000000009e50f187 going to sleep for 11 seconds 00000100:00100000:2.0:1789518039.669942:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627417216 00000100:00100000:2.0:1789518039.669947:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627417216 00000100:00100000:2.0:1789518039.670070:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789518039.670078:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006a97bae0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+6:5793:x1876445627417216:12345-0@lo:101: 00010000:00010000:2.0:1789518039.670084:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518039.670091:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000011b2dd9b/0x631fd8698c78096f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780968 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518039.670114:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000011b2dd9b/0x631fd8698c78096f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780968 expref: 7 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518039.670121:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000011b2dd9b/0x631fd8698c78096f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780968 expref: 7 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518039.670127:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000011b2dd9b, rc 0) 00000100:00100000:2.0:1789518039.670162:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006a97bae0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+7:5793:x1876445627417216:12345-0@lo:101: Request processed in 86us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518039.670169:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789518039.670234:0:5793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000daef77f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:5793:1876445627417216:0@lo:101: 00010000:00010000:0.0:1789518039.670244:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: 00000000740fc4ab/0x631fd8698c780968 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78096f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518039.670250:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: 00000000740fc4ab/0x631fd8698c780968 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c78096f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518039.670258:0:5793:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789518039.670324:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: 00000000740fc4ab/0x631fd8698c780968 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78096f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518039.670332:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: 00000000740fc4ab/0x631fd8698c780968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78096f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518039.670348:0:5793:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789518039.670351:0:5793:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789518039.670354:0:5793:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99ffc84db000 10000000:01000000:0.0:1789518039.670356:0:5793:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789518039.670358:0:5793:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789518039.670360:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789518039.670370:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: 000000001e0bd3e4/0x631fd8698c780976 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518039.670376:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: 000000001e0bd3e4/0x631fd8698c780976 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518039.670381:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: 000000001e0bd3e4/0x631fd8698c780976 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518039.670391:0:5793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000daef77f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:5793:1876445627417344:0@lo:101: 00000100:00100000:0.0:1789518039.670414:0:5793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518039.670427:0:5793:0:(client.c:2716:ptlrpc_set_wait()) set 000000009e50f187 going to sleep for 11 seconds 00000100:00100000:2.0:1789518039.670524:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627417344 00000100:00100000:2.0:1789518039.670529:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627417344 00000100:00100000:2.0:1789518039.670551:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789518039.670556:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003d681f14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+7:5793:x1876445627417344:12345-0@lo:101: 00010000:00010000:2.0:1789518039.670562:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518039.670568:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006252da75/0x631fd8698c78097d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780976 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518039.670866:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006252da75/0x631fd8698c78097d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780976 expref: 8 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518039.670873:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006252da75/0x631fd8698c78097d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780976 expref: 8 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518039.670879:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006252da75, rc 0) 00000100:00100000:2.0:1789518039.670953:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003d681f14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+8:5793:x1876445627417344:12345-0@lo:101: Request processed in 397us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518039.670960:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789518039.671061:0:5793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000daef77f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:5793:1876445627417344:0@lo:101: 00010000:00010000:0.0:1789518039.671071:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: 000000001e0bd3e4/0x631fd8698c780976 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78097d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518039.671078:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: 000000001e0bd3e4/0x631fd8698c780976 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c78097d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518039.671113:0:5793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000daef77f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:5793:1876445627417472:0@lo:501: 00000100:00100000:0.0:1789518039.671134:0:5793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518039.671211:0:5793:0:(client.c:2716:ptlrpc_set_wait()) set 000000009e50f187 going to sleep for 11 seconds 00000100:00100000:1.0:1789518039.671291:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627417472 00000100:00100000:1.0:1789518039.671296:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627417472 00000100:00100000:1.0:1789518039.671362:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789518039.671369:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007d819009 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+8:5793:x1876445627417472:12345-0@lo:501: 00000100:00100000:1.0:1789518039.671568:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007d819009 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+9:5793:x1876445627417472:12345-0@lo:501: Request processed in 201us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518039.671580:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789518039.671632:0:5793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000daef77f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:5793:1876445627417472:0@lo:501: 00000100:00100000:0.0:1789518039.671650:0:5793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000daef77f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:5793:1876445627417600:0@lo:503: 00000100:00100000:0.0:1789518039.671675:0:5793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518039.671693:0:5793:0:(client.c:2716:ptlrpc_set_wait()) set 000000009e50f187 going to sleep for 11 seconds 00000100:00100000:2.0:1789518039.671713:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627417600 00000100:00100000:2.0:1789518039.671717:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627417600 00000100:00100000:2.0:1789518039.671759:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789518039.671766:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000080541d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+9:5793:x1876445627417600:12345-0@lo:503: 00000100:00100000:2.0:1789518039.671881:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000080541d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+9:5793:x1876445627417600:12345-0@lo:503: Request processed in 115us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518039.671887:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789518039.671907:0:5793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000daef77f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:5793:1876445627417600:0@lo:503: 00000100:00100000:0.0:1789518039.672314:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000daef77f0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:5834:1876445627417728:0@lo:502: 00000100:00100000:0.0:1789518039.672346:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518039.672369:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ceb3449c going to sleep for 11 seconds 00000100:00100000:1.0:1789518039.672417:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627417728 00000100:00100000:1.0:1789518039.672421:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627417728 00000100:00100000:1.0:1789518039.672448:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789518039.672458:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009b03d160 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+9:5834:x1876445627417728:12345-0@lo:502: 00000100:00100000:1.0:1789518039.672597:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009b03d160 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+9:5834:x1876445627417728:12345-0@lo:502: Request processed in 139us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518039.672604:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789518039.672659:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000daef77f0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:5834:1876445627417728:0@lo:502: 00000020:01000000:0.0:1789518039.672682:0:5834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518039.672690:0:5834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518039.672692:0:5834:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789518039.672697:0:5834:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789518039.672700:0:5834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789518039.672712:0:5834:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000efe2ea63) 00000020:00000080:0.0:1789518039.672727:0:5834:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789518039.672731:0:5834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789518039.672791:0:5834:0:(osd_handler.c:1614:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789518039.672797:0:5834:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c78098b 00000020:00000080:0.0:1789518039.672988:0:5834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789518039.672992:0:5834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518039.672995:0:5834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518039.672996:0:5834:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789518039.672999:0:5834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518039.673001:0:5834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518039.673002:0:5834:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789518039.673005:0:5834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789518039.673011:0:5834:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000005b6e23ae) 00000020:00000080:0.0:1789518039.673025:0:5834:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789518039.673029:0:5834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789518039.673031:0:5834:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789518039.673033:0:5834:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789518039.673040:0:5834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789518039.673086:0:5834:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000bdee76b from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789518039.673097:0:5834:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000e8108dc6) 00000020:00000080:0.0:1789518039.673102:0:5834:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1789518039.673147:0:5834:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789518039.673150:0:5834:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x631fd8698c7809a0 00000020:00000080:0.0:1789518039.673293:0:5834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1789518039.673299:0:5834:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789518039.673303:0:5834:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x631fd8698c7809a7 00080000:01000000:0.0:1789518039.673308:0:5834:0:(osd_handler.c:1614:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789518039.673310:0:5834:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c7809ae 00080000:10000000:0.0:1789518039.673728:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1789518039.673936:0:5834:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1789518039.676433:0:5834:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1789518039.715250:0:5834:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1789518039.715535:0:5834:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1789518039.717873:0:5834:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1789518039.718111:0:5834:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789518039.745363:0:5834:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000a2d34f9d) 00000020:00000080:1.0:1789518039.745382:0:5834:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789518039.745442:0:5834:0:(osd_handler.c:1614:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789518039.745448:0:5834:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c7809bc 00000020:00000080:1.0:1789518039.746601:0:5834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1789518039.747892:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789518039.782519:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789518039.806409:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789518039.850023:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789518039.893294:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789518039.929609:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1789518039.956566:0:5834:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x631fd8698c7809c3 00000020:00000080:1.0:1789518039.956863:0:5834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789518039.956874:0:5834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518039.956879:0:5834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518039.956881:0:5834:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789518039.956884:0:5834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789518039.956889:0:5834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518039.956890:0:5834:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789518039.956895:0:5834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789518039.956929:0:5834:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789518039.956945:0:5834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518039.956948:0:5834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518039.956950:0:5834:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789518039.956952:0:5834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789518039.956954:0:5834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518039.956956:0:5834:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789518039.956967:0:5834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789518039.956969:0:5834:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789518039.957005:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003150fab1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:5834:1876445627417856:0@lo:502: 00000100:00100000:1.0:1789518039.957110:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518039.957148:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b428538d going to sleep for 11 seconds 00000100:00100000:2.0:1789518039.957201:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627417856 00000100:00100000:2.0:1789518039.957207:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627417856 00000100:00100000:2.0:1789518039.957246:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789518039.957253:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000090d38f40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+9:5834:x1876445627417856:12345-0@lo:502: 00000100:00100000:2.0:1789518039.957556:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000090d38f40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+9:5834:x1876445627417856:12345-0@lo:502: Request processed in 303us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518039.957564:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789518039.957680:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003150fab1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:5834:1876445627417856:0@lo:502: 00000020:01000000:1.0:1789518039.957704:0:5834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518039.957708:0:5834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518039.957709:0:5834:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789518039.957712:0:5834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1789518039.957780:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1789518039.957804:0:5793:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789518039.957819:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: 000000001e0bd3e4/0x631fd8698c780976 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78097d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518039.957829:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: 000000001e0bd3e4/0x631fd8698c780976 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78097d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518039.957848:0:5793:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99ffc84db000 from 1 10000000:01000000:0.0:1789518039.957852:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789518039.957875:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: 00000000f200c488/0x631fd8698c7809ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518039.957882:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: 00000000f200c488/0x631fd8698c7809ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518039.957890:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: 00000000f200c488/0x631fd8698c7809ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518039.957903:0:5793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000daef77f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:5793:1876445627417984:0@lo:101: 00000100:00100000:0.0:1789518039.957932:0:5793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518039.957963:0:5793:0:(client.c:2716:ptlrpc_set_wait()) set 000000002788df22 going to sleep for 11 seconds 00000100:00100000:1.0:1789518039.958015:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627417984 00000100:00100000:1.0:1789518039.958020:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627417984 00000100:00100000:2.0:1789518039.958433:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789518039.958442:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004e8088f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+9:5793:x1876445627417984:12345-0@lo:101: 00010000:00010000:2.0:1789518039.958452:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518039.958463:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ba41c924/0x631fd8698c7809d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c7809ca expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518039.958494:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ba41c924/0x631fd8698c7809d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c7809ca expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518039.958501:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ba41c924/0x631fd8698c7809d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c7809ca expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518039.958507:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ba41c924, rc 0) 00000100:00100000:2.0:1789518039.958537:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004e8088f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+10:5793:x1876445627417984:12345-0@lo:101: Request processed in 97us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518039.958549:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789518039.958568:0:5793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000daef77f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:5793:1876445627417984:0@lo:101: 00010000:00010000:0.0:1789518039.958579:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: 00000000f200c488/0x631fd8698c7809ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7809d1 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518039.958587:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: 00000000f200c488/0x631fd8698c7809ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c7809d1 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518039.959056:0:5793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000daef77f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:5793:1876445627418112:0@lo:256: 00000100:00100000:0.0:1789518039.959090:0:5793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518039.959119:0:5793:0:(client.c:2716:ptlrpc_set_wait()) set 000000002788df22 going to sleep for 11 seconds 00000100:00100000:2.0:1789518039.959159:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627418112 00000100:00100000:2.0:1789518039.959164:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627418112 00000100:00100000:2.0:1789518039.959215:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789518039.959223:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a3eb173c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+10:5793:x1876445627418112:12345-0@lo:256: 20000000:01000000:2.0:1789518039.959235:0:5805:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789518039.959240:0:5805:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789518039.959303:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a3eb173c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+10:5793:x1876445627418112:12345-0@lo:256: Request processed in 82us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518039.959310:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789518039.959368:0:5793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000daef77f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:5793:1876445627418112:0@lo:256: 10000000:01000000:0.0:1789518039.960006:0:5793:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789518039.960017:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: 00000000f200c488/0x631fd8698c7809ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7809d1 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518039.960032:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: 00000000f200c488/0x631fd8698c7809ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7809d1 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518039.960040:0:5793:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ffc84db000 from 1 10000000:01000000:0.0:1789518039.960042:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789518039.960060:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: 000000003c159a37/0x631fd8698c7809d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518039.960066:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: 000000003c159a37/0x631fd8698c7809d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518039.960074:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: 000000003c159a37/0x631fd8698c7809d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518039.960086:0:5793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000daef77f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:5793:1876445627418240:0@lo:101: 00000100:00100000:0.0:1789518039.960112:0:5793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518039.960141:0:5793:0:(client.c:2716:ptlrpc_set_wait()) set 000000002788df22 going to sleep for 11 seconds 00000100:00100000:2.0:1789518039.960369:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627418240 00000100:00100000:2.0:1789518039.960375:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627418240 00000100:00100000:2.0:1789518039.960409:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789518039.960415:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ae9c0ef0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+10:5793:x1876445627418240:12345-0@lo:101: 00010000:00010000:2.0:1789518039.960422:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518039.960431:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000399a7ea8/0x631fd8698c7809df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c7809d8 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518039.960445:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000399a7ea8/0x631fd8698c7809df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c7809d8 expref: 11 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518039.960453:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000399a7ea8/0x631fd8698c7809df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c7809d8 expref: 11 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518039.960460:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000399a7ea8, rc 0) 00000100:00100000:2.0:1789518039.960520:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ae9c0ef0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+11:5793:x1876445627418240:12345-0@lo:101: Request processed in 105us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518039.960526:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789518039.960680:0:5793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000daef77f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:5793:1876445627418240:0@lo:101: 00010000:00010000:0.0:1789518039.960703:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: 000000003c159a37/0x631fd8698c7809d8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7809df expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518039.960711:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: 000000003c159a37/0x631fd8698c7809d8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c7809df expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518039.960748:0:5793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000daef77f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:5793:1876445627418368:0@lo:501: 00000100:00100000:0.0:1789518039.960765:0:5793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518039.960812:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627418368 00000100:00100000:2.0:1789518039.960816:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627418368 00000100:00100000:2.0:1789518039.960845:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789518039.960851:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bb11a077 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+11:5793:x1876445627418368:12345-0@lo:501: 00000100:00100000:0.0:1789518039.961308:0:5793:0:(client.c:2716:ptlrpc_set_wait()) set 000000002788df22 going to sleep for 11 seconds 00000100:00100000:2.0:1789518039.961354:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bb11a077 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+11:5793:x1876445627418368:12345-0@lo:501: Request processed in 503us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518039.961361:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789518039.961435:0:5793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000daef77f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:5793:1876445627418368:0@lo:501: 00000100:00100000:0.0:1789518039.961460:0:5793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000daef77f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:5793:1876445627418496:0@lo:503: 00000100:00100000:0.0:1789518039.961505:0:5793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518039.961522:0:5793:0:(client.c:2716:ptlrpc_set_wait()) set 000000002788df22 going to sleep for 11 seconds 00000100:00100000:1.0:1789518039.961535:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627418496 00000100:00100000:1.0:1789518039.961539:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627418496 00000100:00100000:1.0:1789518039.961568:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789518039.961574:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000095da53a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+11:5793:x1876445627418496:12345-0@lo:503: 00000040:00080000:1.0:1789518039.961603:0:5807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789518039.961689:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000095da53a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+11:5793:x1876445627418496:12345-0@lo:503: Request processed in 116us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518039.961696:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789518039.961732:0:5793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000daef77f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:5793:1876445627418496:0@lo:503: 00000040:00080000:0.0:1789518039.962695:0:5838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1789518039.962830:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1789518039.962853:0:5793:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789518039.962873:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: 000000003c159a37/0x631fd8698c7809d8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7809df expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518039.962883:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: 000000003c159a37/0x631fd8698c7809d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7809df expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518039.962918:0:5793:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789518039.962928:0:5793:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99ffc84db000 10000000:01000000:1.0:1789518039.962930:0:5793:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99ffc84db000 10000000:01000000:1.0:1789518039.962934:0:5793:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789518039.962939:0:5793:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99ffc84db000 from 1 10000000:01000000:1.0:1789518039.962941:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789518039.962964:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: 000000004b7427a2/0x631fd8698c7809e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518039.962976:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: 000000004b7427a2/0x631fd8698c7809e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518039.962984:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: 000000004b7427a2/0x631fd8698c7809e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518039.962997:0:5793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003150fab1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:5793:1876445627418624:0@lo:101: 00000100:00100000:1.0:1789518039.963026:0:5793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518039.963102:0:5793:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b1111a95 going to sleep for 11 seconds 00000100:00100000:2.0:1789518039.963216:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627418624 00000100:00100000:2.0:1789518039.963222:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627418624 00000100:00100000:2.0:1789518039.963328:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789518039.963339:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c0a05db3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+11:5793:x1876445627418624:12345-0@lo:101: 00010000:00010000:2.0:1789518039.963349:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518039.963359:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005cb335f4/0x631fd8698c7809ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c7809e6 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518039.963377:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005cb335f4/0x631fd8698c7809ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c7809e6 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518039.963386:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005cb335f4/0x631fd8698c7809ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c7809e6 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518039.963400:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005cb335f4, rc 0) 00000100:00100000:2.0:1789518039.963435:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c0a05db3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+12:5793:x1876445627418624:12345-0@lo:101: Request processed in 98us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518039.963442:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789518039.963462:0:5793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003150fab1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:5793:1876445627418624:0@lo:101: 00010000:00010000:1.0:1789518039.963486:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: 000000004b7427a2/0x631fd8698c7809e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7809ed expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518039.963495:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: 000000004b7427a2/0x631fd8698c7809e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c7809ed expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518039.963530:0:5793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003150fab1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:5793:1876445627418752:0@lo:501: 00000100:00100000:1.0:1789518039.963553:0:5793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518039.963578:0:5793:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b1111a95 going to sleep for 11 seconds 00000100:00100000:0.0:1789518039.963655:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627418752 00000100:00100000:0.0:1789518039.963659:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627418752 00000100:00100000:0.0:1789518039.963682:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789518039.963688:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c8b88811 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+12:5793:x1876445627418752:12345-0@lo:501: 00000100:00100000:0.0:1789518039.964059:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c8b88811 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+12:5793:x1876445627418752:12345-0@lo:501: Request processed in 371us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518039.964066:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789518039.964130:0:5793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003150fab1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:5793:1876445627418752:0@lo:501: 00000100:00100000:2.0:1789518039.964165:0:5793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a998c60 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:5793:1876445627418880:0@lo:503: 00000100:00100000:2.0:1789518039.964199:0:5793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518039.964217:0:5793:0:(client.c:2716:ptlrpc_set_wait()) set 000000007cf03e37 going to sleep for 11 seconds 00000100:00100000:3.0:1789518039.964261:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627418880 00000100:00100000:3.0:1789518039.964264:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627418880 00000100:00100000:3.0:1789518039.964288:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789518039.964291:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009e9c96cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+12:5793:x1876445627418880:12345-0@lo:503: 00000100:00100000:3.0:1789518039.964569:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009e9c96cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+12:5793:x1876445627418880:12345-0@lo:503: Request processed in 276us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518039.964575:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789518039.964766:0:5793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a998c60 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:5793:1876445627418880:0@lo:503: 00000100:00100000:3.0:1789518039.965067:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007ecf2942 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:5839:1876445627419008:0@lo:502: 00000100:00100000:3.0:1789518039.965108:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518039.965160:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set 0000000057be3813 going to sleep for 11 seconds 00000100:00100000:0.0:1789518039.965185:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627419008 00000100:00100000:0.0:1789518039.965188:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627419008 00000100:00100000:0.0:1789518039.965247:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789518039.965253:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f8855465 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+12:5839:x1876445627419008:12345-0@lo:502: 00000100:00100000:0.0:1789518039.965524:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f8855465 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+12:5839:x1876445627419008:12345-0@lo:502: Request processed in 271us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518039.965531:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789518039.965591:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007ecf2942 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:5839:1876445627419008:0@lo:502: 00000020:01000004:2.0:1789518039.965654:0:5839:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789518039.965674:0:5839:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000cc284ef4) 00000020:00000080:2.0:1789518039.965690:0:5839:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1789518039.965755:0:5839:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000bdee76b from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789518039.965758:0:5839:0:(tgt_mount.c:187:server_put_mount()) put mount 000000000bdee76b from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789518039.965761:0:5839:0:(obd_mount.c:710:lustre_put_lsi()) put 000000000bdee76b 4 00010000:00080000:2.0:1789518039.965784:0:5839:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c3cd67a8@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:2.0:1789518039.967364:0:5839:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1789518039.967552:0:5839:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789518039.967580:0:5839:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789518039.967600:0:5839:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x631fd8698c7809fb 00000100:00080000:2.0:1789518039.967608:0:5839:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789518039.967640:0:5839:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c3cd67a8 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1789518039.967674:0:5839:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006002e68e x1876445627419136/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789518039.967710:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006002e68e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876445627419136:0@lo:38: 00000100:00100000:2.0:1789518039.967759:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789518039.967805:0:5839:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789518039.968100:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627419136 00000100:00100000:0.0:1789518039.968107:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627419136 00000100:00100000:0.0:1789518039.968142:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789518039.968147:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cca2baf7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3279:x1876445627419136:12345-0@lo:38: 00000100:00100000:0.0:1789518039.968242:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cca2baf7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3279:x1876445627419136:12345-0@lo:38: Request processed in 94us (482us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789518039.968253:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789518039.968325:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000daef77f0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:5839:1876445627419264:0@lo:502: 00000100:00100000:0.0:1789518039.968423:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518039.968444:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627419264 00000100:00100000:0.0:1789518039.968447:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627419264 00000100:00100000:0.0:1789518039.968471:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789518039.968490:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000063487820 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+12:5839:x1876445627419264:12345-0@lo:502: 00000100:00100000:0.0:1789518039.968685:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000063487820 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+12:5839:x1876445627419264:12345-0@lo:502: Request processed in 208us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518039.968692:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789518039.968772:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set 0000000048694b85 going to sleep for 11 seconds 00000100:00100000:0.0:1789518039.968789:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000daef77f0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:5839:1876445627419264:0@lo:502: 00000040:00080000:0.0:1789518039.968812:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1789518039.968856:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1789518039.968873:0:5793:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789518039.968886:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: 000000004b7427a2/0x631fd8698c7809e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7809ed expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518039.968895:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: 000000004b7427a2/0x631fd8698c7809e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7809ed expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789518039.968934:0:5793:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789518039.968937:0:5793:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789518039.968938:0:5793:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789518039.968940:0:5793:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789518039.968941:0:5793:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789518039.968942:0:5793:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789518039.968943:0:5793:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789518039.968945:0:5793:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789518039.968950:0:5793:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789518039.968951:0:5793:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789518039.968952:0:5793:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789518039.968953:0:5793:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789518039.968956:0:5793:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1789518039.968958:0:5793:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789518039.968959:0:5793:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789518039.968960:0:5793:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789518039.968961:0:5793:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789518039.968962:0:5793:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789518039.968963:0:5793:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789518039.968963:0:5793:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789518039.968964:0:5793:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789518039.968965:0:5793:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789518039.968965:0:5793:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789518039.968966:0:5793:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789518039.968967:0:5793:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789518039.968979:0:5793:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789518039.968986:0:5793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000daef77f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:5793:1876445627419392:0@lo:253: 00000100:00100000:0.0:1789518039.969013:0:5793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518039.969028:0:5793:0:(client.c:2716:ptlrpc_set_wait()) set 0000000048694b85 going to sleep for 11 seconds 00000100:00100000:0.0:1789518039.969046:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627419392 00000100:00100000:0.0:1789518039.969049:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627419392 00000100:00100000:0.0:1789518039.969069:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789518039.969074:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002752f010 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+12:5793:x1876445627419392:12345-0@lo:253: 20000000:01000000:0.0:1789518039.969093:0:5807:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789518039.969103:0:5807:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1789518039.970280:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789518039.970287:0:3279:0:(import.c:65:import_set_state_nolock()) 00000000c3cd67a8 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789518039.970291:0:3279:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789518039.970294:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006002e68e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876445627419136:0@lo:38: 20000000:01000000:0.0:1789518040.001161:0:5807:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789518040.001190:0:5807:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789518040.001277:0:5827:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789518040.001282:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789518040.001301:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000347f3ccb/0x631fd8698c780a02 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518040.001324:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ba41c924/0x631fd8698c7809d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c7809ca expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518040.001332:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000347f3ccb/0x631fd8698c780a02 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518040.001411:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ba41c924/0x631fd8698c7809d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c7809ca expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518040.001424:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ba41c924/0x631fd8698c7809d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c7809ca expref: 12 pid: 5806 timeout: 243 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518040.001436:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec2d5210 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5827:1876445627419520:0@lo:104: 00000100:00100000:2.0:1789518040.001500:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518040.001547:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 00000000090e6af7 going to sleep for 11 seconds 00000100:00100000:0.0:1789518040.001643:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627419520 00000100:00100000:0.0:1789518040.001650:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627419520 00000100:00100000:0.0:1789518040.001695:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789518040.001702:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ab85eec0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:824c8f07-28fa-48fd-81af-173b194570e6+3:5827:x1876445627419520:12345-0@lo:104: 00010000:00010000:0.0:1789518040.001712:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: 00000000f200c488/0x631fd8698c7809ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c7809d1 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518040.001763:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789518040.001767:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ab85eec0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:824c8f07-28fa-48fd-81af-173b194570e6+3:5827:x1876445627419520:12345-0@lo:104: Request processed in 67us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518040.001773:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789518040.001875:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec2d5210 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5827:1876445627419520:0@lo:104: 00010000:00010000:2.0:1789518040.001895:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000347f3ccb/0x631fd8698c780a02 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518040.001939:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518040.001945:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: 00000000f200c488/0x631fd8698c7809ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c7809d1 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518040.001963:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f200c488 already unused, calling callback (00000000991edda8) 10000000:00010000:1.0:1789518040.001966:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: 00000000f200c488/0x631fd8698c7809ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c7809d1 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518040.001974:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: 00000000f200c488/0x631fd8698c7809ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c7809d1 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518040.001980:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: 00000000f200c488/0x631fd8698c7809ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c7809d1 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518040.001985:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789518040.002021:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: 00000000f200c488/0x631fd8698c7809ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c7809d1 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518040.002028:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789518040.002053:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: 00000000f200c488/0x631fd8698c7809ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c7809d1 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518040.002060:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: 00000000f200c488/0x631fd8698c7809ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c7809d1 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518040.002193:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b0aab73e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:824c8f07-28fa-48fd-81af-173b194570e6:3281:1876445627419648:0@lo:103: 00010000:00010000:1.0:1789518040.002213:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518040.002218:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518040.002220:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518040.002224:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518040.002394:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627419648 00000100:00100000:2.0:1789518040.002399:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627419648 00010000:00010000:2.0:1789518040.002415:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ba41c924/0x631fd8698c7809d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c7809ca expref: 13 pid: 5806 timeout: 243 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518040.002667:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789518040.002676:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000053a89eb6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:824c8f07-28fa-48fd-81af-173b194570e6+13:3281:x1876445627419648:12345-0@lo:103: 00010000:00010000:2.0:1789518040.002686:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518040.002690:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ba41c924/0x631fd8698c7809d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c7809ca expref: 13 pid: 5806 timeout: 243 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518040.002700:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ba41c924/0x631fd8698c7809d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c7809ca expref: 13 pid: 5806 timeout: 243 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518040.002711:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ba41c924/0x631fd8698c7809d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c7809ca expref: 13 pid: 5806 timeout: 243 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518040.002731:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000347f3ccb/0x631fd8698c780a02 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518040.002737:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000347f3ccb/0x631fd8698c780a02 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789518040.002748:0:5797:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001467063s 00010000:00010000:2.0:1789518040.002751:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000347f3ccb/0x631fd8698c780a02 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518040.002757:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000347f3ccb/0x631fd8698c780a02 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518040.002763:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000347f3ccb/0x631fd8698c780a02 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518040.002768:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000347f3ccb/0x631fd8698c780a02 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518040.002773:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000347f3ccb already unused, calling callback (0000000005329a85) 00010000:00010000:2.0:1789518040.002776:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000347f3ccb/0x631fd8698c780a02 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518040.002782:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000347f3ccb/0x631fd8698c780a02 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518040.002860:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000347f3ccb/0x631fd8698c780a02 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518040.002870:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518040.002915:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000053a89eb6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:824c8f07-28fa-48fd-81af-173b194570e6+12:3281:x1876445627419648:12345-0@lo:103: Request processed in 243us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518040.002922:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789518040.002962:0:5827:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000347f3ccb/0x631fd8698c780a02 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518040.002969:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000347f3ccb/0x631fd8698c780a02 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518040.002985:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000347f3ccb/0x631fd8698c780a02 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518040.003095:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b0aab73e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:824c8f07-28fa-48fd-81af-173b194570e6:3281:1876445627419648:0@lo:103: 00000100:00100000:0.0:1789518040.007817:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002752f010 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+11:5793:x1876445627419392:12345-0@lo:253: Request processed in 38735us (38795us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518040.007830:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789518040.007929:0:5793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000daef77f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:5793:1876445627419392:0@lo:253: 10000000:01000000:1.0:1789518040.007943:0:5793:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789518040.007946:0:5793:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789518040.007948:0:5793:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789518040.007949:0:5793:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518040.007951:0:5793:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518040.007952:0:5793:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518040.007953:0:5793:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518040.007954:0:5793:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789518040.007956:0:5793:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789518040.007957:0:5793:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789518040.007959:0:5793:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789518040.007960:0:5793:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518040.007962:0:5793:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789518040.007974:0:5793:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789518040.012946:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1789518040.013378:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789518040.013594:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1789518040.013894:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789518040.014181:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789518040.014350:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1789518040.017147:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1789518040.017358:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1789518040.017565:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1789518040.017766:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1789518040.017952:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1789518040.018114:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1789518040.047981:0:5793:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1789518040.070307:0:5793:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1789518040.070589:0:5844:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1789518040.070593:0:5844:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789518040.071091:0:5845:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789518040.074037:0:5793:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789518040.074336:0:5793:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789518040.076771:0:5793:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789518040.076785:0:5793:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789518040.077728:0:5793:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789518040.080047:0:5793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789518040.080848:0:5793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789518040.080884:0:5793:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1789518040.081499:0:5793:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1789518040.081752:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1789518040.083341:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1789518040.083527:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1789518040.084607:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1789518040.086582:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1789518040.086785:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1789518040.086934:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1789518040.087190:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1789518040.087328:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1789518040.087553:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1789518040.087731:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1789518040.087892:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1789518040.088043:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1789518040.088268:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1789518040.088402:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1789518040.088925:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1789518040.089130:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1789518040.089449:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1789518040.089730:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1789518040.089876:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1789518040.090030:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1789518040.090245:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1789518040.090398:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1789518040.090677:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1789518040.090850:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1789518040.091020:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1789518040.091902:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1789518040.092398:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1789518040.092581:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1789518040.092760:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1789518040.092896:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1789518040.093043:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1789518040.093216:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1789518040.093412:0:5793:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1789518040.095503:0:5845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1789518040.127766:0:5793:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789518040.127793:0:5793:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa50841a07988 00100000:10000000:0.0:1789518040.127799:0:5793:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789518040.128345:0:5793:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789518040.128358:0:5793:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.151@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789518040.128370:0:5793:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1789518040.128383:0:5793:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1789518040.132049:0:5845:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789518040.132114:0:5845:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789518040.132119:0:5845:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1789518040.502954:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518041.522916:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789518042.345864:0:6088:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789518042.546798:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518043.571311:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518044.595129:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789518045.299466:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789518045.299476:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789518045.299479:0:37:0:(import.c:65:import_set_state_nolock()) 00000000c3cd67a8 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789518045.299495:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c3cd67a8 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1789518045.299515:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000093a0ae4c x1876445627419904/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789518045.299554:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000093a0ae4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876445627419904:0@lo:38: 00000100:00100000:0.0:1789518045.299563:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ccb51f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:824c8f07-28fa-48fd-81af-173b194570e6:3282:1876445627419776:0@lo:400: 00000100:00100000:3.0:1789518045.299631:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518045.299640:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518045.299694:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627419904 00000100:00100000:0.0:1789518045.299701:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627419904 00000100:00100000:0.0:1789518045.299729:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789518045.299735:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005f1d5503 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3279:x1876445627419904:12345-0@lo:38: 00010000:00080000:0.0:1789518045.299757:0:5813:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 99 last 0 00000020:00000080:0.0:1789518045.299789:0:5813:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x631fd8698c780a09 00000004:00100000:0.0:1789518045.299827:0:5813:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789518045.299943:0:5813:0:(import.c:65:import_set_state_nolock()) 000000008f9229f5 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789518045.299982:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005f1d5503 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876445627419904:12345-0@lo:38: Request processed in 246us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518045.299989:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789518045.300014:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627419776 00000100:00100000:0.0:1789518045.300018:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627419776 00000100:00100000:0.0:1789518045.300057:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789518045.300064:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000025a3a35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+11:3282:x1876445627419776:12345-0@lo:400: 00000100:00100000:0.0:1789518045.300094:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000025a3a35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+11:3282:x1876445627419776:12345-0@lo:400: Request processed in 31us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518045.300100:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789518045.300138:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ccb51f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:824c8f07-28fa-48fd-81af-173b194570e6:3282:1876445627419776:0@lo:400: 00010000:00080000:3.0:1789518045.300199:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000093a0ae4c x1876445627419904/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789518055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789518045.300216:0:3279:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789518045.300222:0:3279:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789518045.300225:0:3279:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789518045.300227:0:3279:0:(import.c:65:import_set_state_nolock()) 00000000c3cd67a8 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789518045.300231:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000093a0ae4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876445627419904:0@lo:38: 00000020:00000080:0.0:1789518045.403892:0:6289:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc6d08ff20 20000000:00000080:0.0:1789518045.403910:0:6289:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99ffc64cdc00 uarg=0000000000000000 20000000:01000000:0.0:1789518045.403947:0:6289:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1789518045.403953:0:6289:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1789518045.403957:0:6289:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789518045.404210:0:6289:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1789518045.404221:0:6289:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1789518045.407713:0:6289:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789518045.407957:0:6289:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789518045.408092:0:6289:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1789518045.408150:0:6289:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1789518045.408166:0:6289:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789518045.408184:0:6289:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d400fdc7/0x631fd8698c780a10 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518045.408201:0:6289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000399a7ea8/0x631fd8698c7809df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c7809d8 expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518045.408207:0:6289:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d400fdc7/0x631fd8698c780a10 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518045.408241:0:6289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000399a7ea8/0x631fd8698c7809df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c7809d8 expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518045.408261:0:6289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000399a7ea8/0x631fd8698c7809df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c7809d8 expref: 10 pid: 5806 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518045.408274:0:6289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000334927cd pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6289:1876445627420032:0@lo:104: 00000100:00100000:0.0:1789518045.408330:0:6289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518045.408379:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627420032 00000100:00100000:3.0:1789518045.408387:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627420032 00000100:00100000:3.0:1789518045.408432:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789518045.408439:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002ad2b1e0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:824c8f07-28fa-48fd-81af-173b194570e6+3:6289:x1876445627420032:12345-0@lo:104: 00000100:00100000:0.0:1789518045.408445:0:6289:0:(client.c:2716:ptlrpc_set_wait()) set 000000009fb4abb8 going to sleep for 11 seconds 00010000:00010000:3.0:1789518045.408467:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: 000000003c159a37/0x631fd8698c7809d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c7809df expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518045.408535:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789518045.408587:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518045.408593:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: 000000003c159a37/0x631fd8698c7809d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c7809df expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518045.408600:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003c159a37 already unused, calling callback (00000000991edda8) 10000000:00010000:1.0:1789518045.408603:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: 000000003c159a37/0x631fd8698c7809d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c7809df expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518045.408610:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: 000000003c159a37/0x631fd8698c7809d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c7809df expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518045.408634:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: 000000003c159a37/0x631fd8698c7809d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c7809df expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518045.408640:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789518045.408674:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: 000000003c159a37/0x631fd8698c7809d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c7809df expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518045.408680:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789518045.408696:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: 000000003c159a37/0x631fd8698c7809d8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c7809df expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518045.408703:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: 000000003c159a37/0x631fd8698c7809d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c7809df expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518045.408722:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518045.408724:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518045.408726:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518045.408734:0:6289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000334927cd pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6289:1876445627420032:0@lo:104: 00000100:00100000:1.0:1789518045.408737:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005a930fa9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:824c8f07-28fa-48fd-81af-173b194570e6:3283:1876445627420160:0@lo:103: 00010000:00010000:0.0:1789518045.408751:0:6289:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000d400fdc7/0x631fd8698c780a10 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518045.408771:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518045.408796:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627420160 00000100:00100000:0.0:1789518045.408800:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627420160 00010000:00010000:0.0:1789518045.408815:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000399a7ea8/0x631fd8698c7809df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c7809d8 expref: 11 pid: 5806 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518045.408842:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789518045.408852:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c21d52d3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:824c8f07-28fa-48fd-81af-173b194570e6+11:3283:x1876445627420160:12345-0@lo:103: 00000100:00100000:3.0:1789518045.408853:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002ad2b1e0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:824c8f07-28fa-48fd-81af-173b194570e6+3:6289:x1876445627420032:12345-0@lo:104: Request processed in 103us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518045.408865:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1789518045.408865:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518045.408873:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000399a7ea8/0x631fd8698c7809df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c7809d8 expref: 11 pid: 5806 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518045.408886:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000399a7ea8/0x631fd8698c7809df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c7809d8 expref: 11 pid: 5806 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518045.408898:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000399a7ea8/0x631fd8698c7809df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c7809d8 expref: 11 pid: 5806 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518045.408912:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d400fdc7/0x631fd8698c780a10 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518045.408924:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d400fdc7/0x631fd8698c780a10 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518045.408934:0:5799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d400fdc7/0x631fd8698c780a10 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518045.408938:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d400fdc7/0x631fd8698c780a10 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518045.408942:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d400fdc7/0x631fd8698c780a10 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518045.408945:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d400fdc7/0x631fd8698c780a10 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518045.408948:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d400fdc7 already unused, calling callback (0000000005329a85) 00010000:00010000:0.0:1789518045.408950:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d400fdc7/0x631fd8698c780a10 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518045.408953:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d400fdc7/0x631fd8698c780a10 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518045.408964:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d400fdc7/0x631fd8698c780a10 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518045.408970:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518045.408995:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c21d52d3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:824c8f07-28fa-48fd-81af-173b194570e6+10:3283:x1876445627420160:12345-0@lo:103: Request processed in 147us (223us total) trans 0 rc 0/0 00010000:00010000:3.0:1789518045.408996:0:6289:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000d400fdc7/0x631fd8698c780a10 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518045.409009:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789518045.409012:0:6289:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d400fdc7/0x631fd8698c780a10 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518045.409029:0:6289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d400fdc7/0x631fd8698c780a10 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518045.409084:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005a930fa9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:824c8f07-28fa-48fd-81af-173b194570e6:3283:1876445627420160:0@lo:103: 00010000:00010000:0.0:1789518045.618802:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518046.642854:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518047.668910:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789518048.371195:0:5810:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789518048.371202:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99ffc84db000 from 3 10000000:01000000:2.0:1789518048.371206:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789518048.371246:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: 00000000399a7ea8/0x631fd8698c780a17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.371257:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: 00000000399a7ea8/0x631fd8698c780a17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.371267:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: 00000000399a7ea8/0x631fd8698c780a17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518048.371389:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec2d5210 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627420288:0@lo:101: 00000100:00100000:2.0:1789518048.371461:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518048.371509:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 0000000037534923 going to sleep for 11 seconds 00000100:00100000:0.0:1789518048.371673:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627420288 00000100:00100000:0.0:1789518048.371682:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627420288 00000100:00100000:0.0:1789518048.371723:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789518048.371729:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002fd42734 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+10:5810:x1876445627420288:12345-0@lo:101: 00010000:00010000:0.0:1789518048.371741:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518048.371754:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f200c488/0x631fd8698c780a1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780a17 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518048.371775:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f200c488/0x631fd8698c780a1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780a17 expref: 11 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518048.371786:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f200c488/0x631fd8698c780a1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780a17 expref: 11 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518048.371794:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f200c488, rc 0) 00000100:00100000:0.0:1789518048.371835:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002fd42734 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+11:5810:x1876445627420288:12345-0@lo:101: Request processed in 106us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518048.371842:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789518048.371897:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec2d5210 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627420288:0@lo:101: 00010000:00010000:2.0:1789518048.371910:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: 00000000399a7ea8/0x631fd8698c780a17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780a1e expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.371918:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: 00000000399a7ea8/0x631fd8698c780a17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780a1e expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518048.371963:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec2d5210 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627420416:0@lo:256: 00000100:00100000:2.0:1789518048.371991:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518048.372015:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 0000000037534923 going to sleep for 11 seconds 00000100:00100000:0.0:1789518048.372371:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627420416 00000100:00100000:0.0:1789518048.372376:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627420416 00000100:00100000:0.0:1789518048.372409:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789518048.372416:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eeca2937 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+11:5810:x1876445627420416:12345-0@lo:256: 20000000:01000000:0.0:1789518048.372428:0:5806:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789518048.372453:0:5806:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789518048.372456:0:5806:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1789518048.372544:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eeca2937 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+11:5810:x1876445627420416:12345-0@lo:256: Request processed in 129us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518048.372551:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789518048.372653:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec2d5210 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627420416:0@lo:256: 10000000:01000000:1.0:1789518048.372697:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789518048.372704:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: 00000000399a7ea8/0x631fd8698c780a17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780a1e expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518048.372712:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: 00000000399a7ea8/0x631fd8698c780a17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780a1e expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518048.372720:0:5810:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789518048.372722:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ffc84db000 from 1 10000000:01000000:1.0:1789518048.372725:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789518048.372741:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: 000000002f1eb917/0x631fd8698c780a25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518048.372749:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: 000000002f1eb917/0x631fd8698c780a25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518048.372756:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: 000000002f1eb917/0x631fd8698c780a25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518048.372767:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005a930fa9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627420544:0@lo:101: 00000100:00100000:1.0:1789518048.372793:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518048.372804:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bab5d709 going to sleep for 11 seconds 00000100:00100000:0.0:1789518048.373061:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627420544 00000100:00100000:0.0:1789518048.373066:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627420544 00000100:00100000:0.0:1789518048.373093:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789518048.373099:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006aa755a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+11:5810:x1876445627420544:12345-0@lo:101: 00010000:00010000:0.0:1789518048.373105:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518048.373113:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000011d75012/0x631fd8698c780a2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780a25 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518048.373126:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000011d75012/0x631fd8698c780a2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780a25 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518048.373134:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000011d75012/0x631fd8698c780a2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780a25 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518048.373140:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000011d75012, rc 0) 00000100:00100000:0.0:1789518048.373173:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006aa755a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+12:5810:x1876445627420544:12345-0@lo:101: Request processed in 74us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518048.373178:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789518048.373274:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005a930fa9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627420544:0@lo:101: 00010000:00010000:1.0:1789518048.373351:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: 000000002f1eb917/0x631fd8698c780a25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780a2c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518048.373365:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: 000000002f1eb917/0x631fd8698c780a25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780a2c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518048.373405:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005a930fa9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627420672:0@lo:501: 00000100:00100000:1.0:1789518048.373429:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518048.373463:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bab5d709 going to sleep for 11 seconds 00000100:00100000:2.0:1789518048.373532:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627420672 00000100:00100000:2.0:1789518048.373537:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627420672 00000100:00100000:2.0:1789518048.373569:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789518048.373575:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c38f58a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+12:5810:x1876445627420672:12345-0@lo:501: 00000100:00100000:2.0:1789518048.373833:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c38f58a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+12:5810:x1876445627420672:12345-0@lo:501: Request processed in 258us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518048.373840:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789518048.373899:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005a930fa9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627420672:0@lo:501: 00000100:00100000:3.0:1789518048.373928:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000093a0ae4c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627420800:0@lo:503: 00000100:00100000:3.0:1789518048.373958:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518048.373977:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 00000000362d4c58 going to sleep for 11 seconds 00000100:00100000:2.0:1789518048.373994:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627420800 00000100:00100000:2.0:1789518048.373999:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627420800 00000100:00100000:2.0:1789518048.374016:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789518048.374036:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009031474d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+12:5810:x1876445627420800:12345-0@lo:503: 00000100:00100000:2.0:1789518048.374149:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009031474d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+12:5810:x1876445627420800:12345-0@lo:503: Request processed in 114us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518048.374156:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789518048.374210:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000093a0ae4c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627420800:0@lo:503: 00000100:00100000:0.0:1789518048.375235:0:6623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000334927cd pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:6623:1876445627420928:0@lo:502: 00000100:00100000:0.0:1789518048.375301:0:6623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518048.375334:0:6623:0:(client.c:2716:ptlrpc_set_wait()) set 000000006f123e1b going to sleep for 11 seconds 00000100:00100000:2.0:1789518048.375342:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627420928 00000100:00100000:2.0:1789518048.375349:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627420928 00000100:00100000:2.0:1789518048.375432:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789518048.375452:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003cf246c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+12:6623:x1876445627420928:12345-0@lo:502: 00000100:00100000:2.0:1789518048.375594:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003cf246c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+12:6623:x1876445627420928:12345-0@lo:502: Request processed in 143us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518048.375601:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789518048.375697:0:6623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000334927cd pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:6623:1876445627420928:0@lo:502: 00000020:01000000:0.0:1789518048.375719:0:6623:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518048.375727:0:6623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518048.375729:0:6623:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789518048.375736:0:6623:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ffc84db000 00000020:00000080:0.0:1789518048.375738:0:6623:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789518048.375772:0:6623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6503b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:6623:1876445627421056:0@lo:502: 00000100:00100000:0.0:1789518048.375805:0:6623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518048.375838:0:6623:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffc27a480 going to sleep for 11 seconds 00000100:00100000:2.0:1789518048.375844:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627421056 00000100:00100000:2.0:1789518048.375849:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627421056 00000100:00100000:2.0:1789518048.375907:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789518048.375915:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+12:6623:x1876445627421056:12345-0@lo:502: 00000100:00100000:2.0:1789518048.376011:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+12:6623:x1876445627421056:12345-0@lo:502: Request processed in 97us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518048.376027:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789518048.376099:0:6623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6503b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:6623:1876445627421056:0@lo:502: 00000020:01000000:0.0:1789518048.376118:0:6623:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518048.376123:0:6623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518048.376124:0:6623:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789518048.376128:0:6623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1789518048.376342:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789518048.376358:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789518048.376364:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1800/0x631fd8698c780a25 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780a2c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518048.376372:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1800/0x631fd8698c780a25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780a2c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518048.690758:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789518048.715931:0:6645:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789518048.715934:0:6645:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789518048.716073:0:6645:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99ffc76f3000 00000020:01000004:2.0:1789518048.716087:0:6645:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789518048.716098:0:6645:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789518048.716110:0:6645:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff99fff4204d40) 00000020:00000080:2.0:1789518048.716124:0:6645:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789518048.734069:0:6645:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789518048.734335:0:6645:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789518048.760747:0:6645:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789518048.764922:0:6645:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789518048.764956:0:6645:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789518048.765022:0:6645:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789518048.765052:0:6645:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789518048.765359:0:6645:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789518048.765368:0:6645:0:(osd_handler.c:1614:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789518048.765383:0:6645:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x631fd8698c780a3a 00000020:01000004:3.0:1789518048.765390:0:6645:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789518048.765408:0:6645:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.151@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789518048.765411:0:6645:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789518048.765417:0:6645:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789518048.765421:0:6645:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789518048.765430:0:6645:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff99ffc64a3380) 00000020:00000080:3.0:1789518048.765453:0:6645:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1789518048.766727:0:6645:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789518048.766883:0:6645:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789518048.766897:0:6645:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789518048.769648:0:6645:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789518048.769657:0:6645:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789518048.770924:0:6645:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789518048.770934:0:6645:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789518048.772414:0:6645:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789518048.772608:0:6645:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789518048.772789:0:6645:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789518048.773165:0:6645:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789518048.773173:0:6645:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789518048.789317:0:6645:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789518048.789498:0:6645:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789518048.789502:0:6645:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789518048.790717:0:6645:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789518048.790726:0:6645:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789518048.791300:0:6645:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789518048.791305:0:6645:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789518048.793306:0:6645:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789518048.793474:0:6645:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789518048.793480:0:6645:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789518048.794181:0:6645:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789518048.794189:0:6645:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789518048.822289:0:6645:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789518048.822567:0:6645:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789518048.822574:0:6645:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789518048.823501:0:6645:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789518048.823510:0:6645:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789518048.826963:0:6645:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789518048.826988:0:6645:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1789518048.826992:0:6645:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.151@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789518048.840090:0:6645:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789518048.840126:0:6645:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.151@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1789518048.840130:0:6645:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789518048.840132:0:6645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789518048.840133:0:6645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789518048.840135:0:6645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789518048.840136:0:6645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789518048.840138:0:6645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789518048.840139:0:6645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789518048.840141:0:6645:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789518048.840142:0:6645:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789518048.840143:0:6645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789518048.840145:0:6645:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789518048.840148:0:6645:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1789518048.840150:0:6645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789518048.840151:0:6645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789518048.840152:0:6645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789518048.840153:0:6645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789518048.840155:0:6645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789518048.840156:0:6645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789518048.840157:0:6645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789518048.840158:0:6645:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789518048.840159:0:6645:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789518048.840160:0:6645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789518048.840161:0:6645:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789518048.840184:0:6645:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789518048.840200:0:6645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627421184:0@lo:253: 00000100:00100000:2.0:1789518048.840258:0:6645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518048.840373:0:6645:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffe05026c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518048.840472:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627421184 00000100:00100000:0.0:1789518048.840481:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627421184 00000100:00100000:0.0:1789518048.840563:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789518048.840571:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+12:6645:x1876445627421184:12345-0@lo:253: 20000000:01000000:0.0:1789518048.840597:0:5806:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789518048.840600:0:5806:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1789518048.840605:0:5806:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1789518048.840608:0:5806:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1789518048.841346:0:5806:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789518048.841567:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1789518048.841581:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1789518048.841640:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1789518048.841649:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1789518048.841682:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1789518048.841726:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1789518048.842059:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1789518048.842075:0:5806:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.151@tcp 20000000:01000000:0.0:1789518048.842076:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.151@tcp (null) (null) (null) 00000040:00080000:0.0:1789518048.842107:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1789518048.842114:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789518048.842153:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1789518048.842160:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.151@tcp (null) (null) 00000040:00080000:0.0:1789518048.842192:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1789518048.842202:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789518048.842243:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1789518048.842289:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1789518048.842899:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1789518048.842914:0:5806:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.151@tcp 20000000:01000000:0.0:1789518048.842915:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.151@tcp (null) (null) (null) 00000040:00080000:0.0:1789518048.842947:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1789518048.842954:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789518048.842981:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1789518048.842988:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.151@tcp (null) (null) 00000040:00080000:0.0:1789518048.843048:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1789518048.843058:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789518048.843091:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1789518048.843123:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1789518048.843138:0:5806:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789518048.843140:0:5806:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789518048.843143:0:5806:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789518048.843154:0:5806:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789518048.843156:0:5806:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789518048.843183:0:5806:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789518048.843185:0:5806:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789518048.844019:0:6660:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1789518048.844067:0:6660:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1789518048.844110:0:6660:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1789518048.844385:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1789518048.844429:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1789518048.844480:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1789518048.844492:0:5806:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789518048.844495:0:5806:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789518048.845068:0:6661:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:2.0:1789518048.845116:0:6661:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:2.0:1789518048.845160:0:6661:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1789518048.845372:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1789518048.845411:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1789518048.845477:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1789518048.845490:0:5806:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789518048.845492:0:5806:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789518048.846047:0:6662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1789518048.846239:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1789518048.846276:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1789518048.846325:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1789518048.846348:0:5806:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1789518048.846350:0:5806:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1789518048.846357:0:5806:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789518048.846375:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ffc0030800/0x631fd8698c780a48 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518048.846390:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780961 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c78095a expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518048.846398:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffc29c8000/0x631fd8698c78097d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780976 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518048.846404:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffc29c9800/0x631fd8698c7809ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c7809e6 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518048.846411:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ffc0030800/0x631fd8698c780a48 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518048.846455:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffc29c9800/0x631fd8698c7809ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c7809e6 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518048.846469:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffc29c9800/0x631fd8698c7809ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c7809e6 expref: 12 pid: 5806 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518048.846482:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6503b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5806:1876445627421312:0@lo:104: 00000100:00100000:0.0:1789518048.846534:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789518048.846739:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffc29c8000/0x631fd8698c78097d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c780976 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518048.846748:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffc29c8000/0x631fd8698c78097d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c780976 expref: 12 pid: 5806 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518048.846768:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6501f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5806:1876445627421440:0@lo:104: 00000100:00100000:0.0:1789518048.846791:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789518048.846902:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c78095a expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518048.846911:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780961 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c78095a expref: 12 pid: 5806 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518048.846918:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6503100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5806:1876445627421568:0@lo:104: 00000100:00100000:0.0:1789518048.846940:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518048.846991:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627421312 00000100:00100000:1.0:1789518048.846998:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627421312 00000100:00100000:1.0:1789518048.847026:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627421440 00000100:00100000:1.0:1789518048.847028:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627421440 00000100:00100000:1.0:1789518048.847041:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789518048.847048:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6502680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:824c8f07-28fa-48fd-81af-173b194570e6+4:5806:x1876445627421312:12345-0@lo:104: 00010000:00010000:1.0:1789518048.847059:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0200/0x631fd8698c7809e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c7809ed expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518048.847114:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789518048.847120:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6502680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:824c8f07-28fa-48fd-81af-173b194570e6+4:5806:x1876445627421312:12345-0@lo:104: Request processed in 73us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518048.847127:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789518048.847142:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789518048.847147:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6503800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:824c8f07-28fa-48fd-81af-173b194570e6+3:5806:x1876445627421440:12345-0@lo:104: 00010000:00010000:1.0:1789518048.847153:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffc0030200/0x631fd8698c780976 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c78097d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518048.847188:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789518048.847193:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6503800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:824c8f07-28fa-48fd-81af-173b194570e6+3:5806:x1876445627421440:12345-0@lo:104: Request processed in 47us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518048.847208:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789518048.847265:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789518048.847271:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0200/0x631fd8698c7809e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c7809ed expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.847278:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0200 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:2.0:1789518048.847282:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0200/0x631fd8698c7809e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c7809ed expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.847290:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0200/0x631fd8698c7809e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c7809ed expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518048.847296:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0200/0x631fd8698c7809e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c7809ed expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518048.847301:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789518048.847335:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0200/0x631fd8698c7809e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c7809ed expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.847342:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789518048.847360:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0200/0x631fd8698c7809e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c7809ed expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.847367:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0200/0x631fd8698c7809e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c7809ed expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.847379:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518048.847382:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc0030200/0x631fd8698c780976 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c78097d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.847398:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc0030200 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:2.0:1789518048.847401:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc0030200/0x631fd8698c780976 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c78097d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.847407:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc0030200/0x631fd8698c780976 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c78097d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518048.847413:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc0030200/0x631fd8698c780976 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c78097d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518048.847418:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789518048.847430:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffc0030200/0x631fd8698c780976 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c78097d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.847447:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789518048.847453:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc0030200/0x631fd8698c780976 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c78097d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.847459:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc0030200/0x631fd8698c780976 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c78097d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.847470:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518048.847472:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518048.847474:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518048.847485:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:824c8f07-28fa-48fd-81af-173b194570e6:3280:1876445627421696:0@lo:103: 00000100:00100000:2.0:1789518048.847513:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518048.847535:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789518048.847541:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:824c8f07-28fa-48fd-81af-173b194570e6:3280:1876445627421824:0@lo:103: 00000100:00100000:2.0:1789518048.847570:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518048.847598:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627421696 00000100:00100000:2.0:1789518048.847602:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627421696 00010000:00010000:2.0:1789518048.847638:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffc29c9800/0x631fd8698c7809ed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c7809e6 expref: 13 pid: 5806 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518048.847656:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627421824 00000100:00100000:2.0:1789518048.847658:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627421824 00010000:00010000:2.0:1789518048.847669:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffc29c8000/0x631fd8698c78097d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780976 expref: 14 pid: 5806 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518048.847680:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789518048.847686:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:824c8f07-28fa-48fd-81af-173b194570e6+14:3280:x1876445627421696:12345-0@lo:103: 00010000:00010000:2.0:1789518048.847695:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518048.847699:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffc29c9800/0x631fd8698c7809ed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c7809e6 expref: 14 pid: 5806 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.847708:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffc29c9800/0x631fd8698c7809ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c7809e6 expref: 14 pid: 5806 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.847721:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518048.847745:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:824c8f07-28fa-48fd-81af-173b194570e6+14:3280:x1876445627421696:12345-0@lo:103: Request processed in 60us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518048.847751:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789518048.847763:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789518048.847769:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:824c8f07-28fa-48fd-81af-173b194570e6+13:3280:x1876445627421824:12345-0@lo:103: 00010000:00010000:2.0:1789518048.847776:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518048.847780:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffc29c8000/0x631fd8698c78097d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780976 expref: 13 pid: 5806 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.847798:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffc29c8000/0x631fd8698c78097d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c780976 expref: 13 pid: 5806 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.847807:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518048.847829:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:824c8f07-28fa-48fd-81af-173b194570e6+13:3280:x1876445627421824:12345-0@lo:103: Request processed in 60us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518048.847835:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789518048.847865:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:824c8f07-28fa-48fd-81af-173b194570e6:3280:1876445627421824:0@lo:103: 00000100:00100000:2.0:1789518048.847873:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:824c8f07-28fa-48fd-81af-173b194570e6:3280:1876445627421696:0@lo:103: 00010000:00010000:0.0:1789518048.848062:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518048.848080:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc516c780 going to sleep for 11 seconds 00010000:00010000:0.0:1789518048.848093:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc29c9800/0x631fd8698c7809ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c7809e6 expref: 12 pid: 5806 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518048.848107:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6503b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5806:1876445627421312:0@lo:104: 00010000:00010000:0.0:1789518048.848116:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc29c8000/0x631fd8698c78097d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c780976 expref: 11 pid: 5806 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518048.848124:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6501f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5806:1876445627421440:0@lo:104: 00000100:00100000:2.0:1789518048.848211:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627421568 00000100:00100000:2.0:1789518048.848215:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627421568 00000100:00100000:2.0:1789518048.848235:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789518048.848240:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6501180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:824c8f07-28fa-48fd-81af-173b194570e6+3:5806:x1876445627421568:12345-0@lo:104: 00010000:00010000:2.0:1789518048.848247:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffc0030000/0x631fd8698c78095a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780961 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.848299:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789518048.848305:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6501180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:824c8f07-28fa-48fd-81af-173b194570e6+3:5806:x1876445627421568:12345-0@lo:104: Request processed in 66us (1365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518048.848311:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789518048.848359:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6503100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5806:1876445627421568:0@lo:104: 00010000:00010000:0.0:1789518048.848378:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ffc0030800/0x631fd8698c780a48 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518048.848424:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518048.848429:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc0030000/0x631fd8698c78095a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780961 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518048.848447:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc0030000 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:1.0:1789518048.848450:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc0030000/0x631fd8698c78095a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c780961 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518048.848457:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc0030000/0x631fd8698c78095a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c780961 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518048.848464:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc0030000/0x631fd8698c78095a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c780961 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518048.848469:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789518048.848496:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffc0030000/0x631fd8698c78095a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780961 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518048.848502:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789518048.848525:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc0030000/0x631fd8698c78095a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780961 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518048.848531:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc0030000/0x631fd8698c78095a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780961 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518048.848545:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518048.848547:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518048.848549:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518048.848555:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789518048.848569:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4000700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:824c8f07-28fa-48fd-81af-173b194570e6:3283:1876445627421952:0@lo:103: 00000100:00100000:1.0:1789518048.848596:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518048.848747:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627421952 00000100:00100000:2.0:1789518048.848752:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627421952 00010000:00010000:2.0:1789518048.848766:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780961 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c78095a expref: 11 pid: 5806 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518048.848794:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789518048.848801:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4000e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:824c8f07-28fa-48fd-81af-173b194570e6+11:3283:x1876445627421952:12345-0@lo:103: 00010000:00010000:2.0:1789518048.848814:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518048.848819:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780961 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c78095a expref: 11 pid: 5806 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.848828:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c78095a expref: 11 pid: 5806 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.848838:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780961 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c78095a expref: 11 pid: 5806 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.848848:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ffc0030800/0x631fd8698c780a48 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.848856:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc0030800/0x631fd8698c780a48 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.848868:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffc0030800/0x631fd8698c780a48 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.848875:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffc0030800/0x631fd8698c780a48 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.848882:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ffc0030800/0x631fd8698c780a48 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.848889:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ffc0030800/0x631fd8698c780a48 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.848894:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc0030800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518048.848897:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ffc0030800/0x631fd8698c780a48 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.848914:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ffc0030800/0x631fd8698c780a48 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.848933:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ffc0030800/0x631fd8698c780a48 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.848942:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518048.848970:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4000e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:824c8f07-28fa-48fd-81af-173b194570e6+10:3283:x1876445627421952:12345-0@lo:103: Request processed in 170us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518048.848977:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789518048.849002:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4000700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:824c8f07-28fa-48fd-81af-173b194570e6:3283:1876445627421952:0@lo:103: 00010000:00010000:0.0:1789518048.849046:0:5806:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ffc0030800/0x631fd8698c780a48 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518048.849054:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ffc0030800/0x631fd8698c780a48 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518048.849065:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc0030800/0x631fd8698c780a48 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789518048.849077:0:5806:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789518048.878607:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+9:6645:x1876445627421184:12345-0@lo:253: Request processed in 38029us (38340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518048.878635:0:6645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627421184:0@lo:253: 10000000:01000000:2.0:1789518048.878650:0:6645:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789518048.878654:0:6645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789518048.878655:0:6645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789518048.878657:0:6645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789518048.878658:0:6645:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1789518048.878659:0:6645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789518048.878663:0:6645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789518048.878664:0:6645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789518048.878665:0:6645:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789518048.878667:0:6645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789518048.878668:0:6645:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789518048.878744:0:6645:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99ffc76f3000 from lustre-OST0000 00000100:00100000:0.0:1789518048.878750:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 10000000:01000000:3.0:1789518048.878765:0:6645:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789518048.878768:0:6645:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789518048.878774:0:6645:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99ffc64a4d40 local copy 10000000:01000000:3.0:1789518048.878777:0:6645:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789518048.878808:0:6645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9a00021c6800/0x631fd8698c780a4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518048.878820:0:6645:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.151@tcp lock: ffff9a00021c6800/0x631fd8698c780a4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518048.878827:0:6645:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9a00021c6800/0x631fd8698c780a4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518048.878839:0:6645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0790a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627422080:0@lo:101: 00000100:00100000:3.0:1789518048.878873:0:6645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518048.878910:0:6645:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc76c4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789518048.878959:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627422080 00000100:00100000:2.0:1789518048.878965:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627422080 00000100:00100000:2.0:1789518048.878994:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789518048.879005:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+9:6645:x1876445627422080:12345-0@lo:101: 00010000:00010000:2.0:1789518048.879017:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518048.879029:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780a56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780a4f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.879065:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780a56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780a4f expref: 10 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.879095:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780a56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780a4f expref: 10 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.879104:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29c8800, rc 0) 00000100:00100000:2.0:1789518048.879141:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+10:6645:x1876445627422080:12345-0@lo:101: Request processed in 136us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518048.879148:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789518048.879292:0:6645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0790a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627422080:0@lo:101: 00010000:00010000:3.0:1789518048.879301:0:6645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9a00021c6800/0x631fd8698c780a4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x631fd8698c780a56 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518048.879313:0:6645:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9a00021c6800/0x631fd8698c780a4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x631fd8698c780a56 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518048.879389:0:6645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0790a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627422208:0@lo:501: 00000100:00100000:3.0:1789518048.879417:0:6645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518048.879464:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627422208 00000100:00100000:0.0:1789518048.879468:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627422208 00000100:00100000:0.0:1789518048.879495:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789518048.879500:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+10:6645:x1876445627422208:12345-0@lo:501: 00000100:00100000:3.0:1789518048.879563:0:6645:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc76c4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518048.879688:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+10:6645:x1876445627422208:12345-0@lo:501: Request processed in 186us (268us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789518048.879695:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789518048.879707:0:6645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0790a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627422208:0@lo:501: 10000000:01000000:3.0:1789518048.879719:0:6645:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789518048.879743:0:6645:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789518048.879749:0:6645:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9a00021c6800/0x631fd8698c780a4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x631fd8698c780a56 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518048.879757:0:6645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9a00021c6800/0x631fd8698c780a4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x631fd8698c780a56 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518048.879764:0:6645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff9a00021c6800/0x631fd8698c780a4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x631fd8698c780a56 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518048.879782:0:6645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789518048.879797:0:6645:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99ffc76f3000 10000000:01000000:3.0:1789518048.879802:0:6645:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789518048.879805:0:6645:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff99ffc64a4d40 10000000:01000000:3.0:1789518048.879808:0:6645:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789518048.879811:0:6645:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff99ffc64a4d40 from 1 10000000:01000000:3.0:1789518048.879814:0:6645:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789518048.879828:0:6645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9a00021c7800/0x631fd8698c780a5d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518048.879842:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518048.879845:0:6645:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9a00021c7800/0x631fd8698c780a5d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518048.879847:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9a00021c6800/0x631fd8698c780a4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x631fd8698c780a56 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518048.879853:0:6645:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9a00021c7800/0x631fd8698c780a5d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518048.879854:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6800 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:0.0:1789518048.879858:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9a00021c6800/0x631fd8698c780a4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x631fd8698c780a56 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518048.879864:0:6645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0790a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627422336:0@lo:101: 00010000:00010000:0.0:1789518048.879866:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9a00021c6800/0x631fd8698c780a4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x631fd8698c780a56 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518048.879872:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9a00021c6800/0x631fd8698c780a4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x631fd8698c780a56 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518048.879886:0:6645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1789518048.879887:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789518048.879903:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9a00021c6800/0x631fd8698c780a4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x631fd8698c780a56 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518048.879909:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789518048.879914:0:6645:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc76c4540 going to sleep for 11 seconds 00000100:00100000:1.0:1789518048.879956:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:824c8f07-28fa-48fd-81af-173b194570e6:3283:1876445627422464:0@lo:103: 00000100:00100000:2.0:1789518048.879962:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627422336 00000100:00100000:2.0:1789518048.879965:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627422336 00000100:00100000:1.0:1789518048.879994:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518048.879995:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789518048.880002:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+10:6645:x1876445627422336:12345-0@lo:101: 00010000:00010000:2.0:1789518048.880008:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518048.880016:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc29c9e00/0x631fd8698c780a64 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780a5d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518048.880036:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9a00021c6800/0x631fd8698c780a4f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x631fd8698c780a56 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518048.880045:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9a00021c6800/0x631fd8698c780a4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x631fd8698c780a56 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518048.880059:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518048.880061:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518048.880062:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518048.880078:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc29c9e00/0x631fd8698c780a64 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780a5d expref: 11 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518048.880082:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627422464 00000100:00100000:0.0:1789518048.880085:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627422464 00010000:00010000:2.0:1789518048.880087:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc29c9e00/0x631fd8698c780a64 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780a5d expref: 11 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.880094:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29c9e00, rc 0) 00000100:00100000:2.0:1789518048.880120:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+12:6645:x1876445627422336:12345-0@lo:101: Request processed in 118us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518048.880120:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789518048.880126:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789518048.880126:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4001500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:824c8f07-28fa-48fd-81af-173b194570e6+12:3283:x1876445627422464:12345-0@lo:103: 00010000:00010000:0.0:1789518048.880134:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518048.880144:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780a56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c780a4f expref: 11 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518048.880166:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518048.880235:0:6645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0790a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627422336:0@lo:101: 00010000:00010000:3.0:1789518048.880245:0:6645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9a00021c7800/0x631fd8698c780a5d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780a64 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518048.880253:0:6645:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9a00021c7800/0x631fd8698c780a5d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780a64 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518048.880266:0:6645:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789518048.880284:0:6645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9a00021c7800/0x631fd8698c780a5d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780a64 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518048.880291:0:6645:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9a00021c7800/0x631fd8698c780a5d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780a64 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518048.880298:0:6645:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789518048.880302:0:6645:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789518048.880306:0:6645:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789518048.880308:0:6645:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789518048.880321:0:6645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9a00021c6000/0x631fd8698c780a6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518048.880345:0:6645:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9a00021c6000/0x631fd8698c780a6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518048.880353:0:6645:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9a00021c6000/0x631fd8698c780a6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518048.880363:0:6645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0790a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627422592:0@lo:101: 00000100:00100000:3.0:1789518048.880388:0:6645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518048.880406:0:6645:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc76c4540 going to sleep for 11 seconds 00000100:00100000:2.0:1789518048.880466:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627422592 00000100:00100000:2.0:1789518048.880470:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627422592 00000100:00100000:2.0:1789518048.880501:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789518048.880507:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+11:6645:x1876445627422592:12345-0@lo:101: 00010000:00010000:2.0:1789518048.880513:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518048.880522:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc29c8000/0x631fd8698c780a72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780a6b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.880535:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc29c8000/0x631fd8698c780a72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780a6b expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.880542:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc29c8000/0x631fd8698c780a72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780a6b expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.880548:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29c8000, rc 0) 00000100:00100000:2.0:1789518048.880575:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+12:6645:x1876445627422592:12345-0@lo:101: Request processed in 68us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518048.880581:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789518048.880639:0:6645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0790a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627422592:0@lo:101: 00010000:00010000:3.0:1789518048.880649:0:6645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9a00021c6000/0x631fd8698c780a6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780a72 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518048.880656:0:6645:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9a00021c6000/0x631fd8698c780a6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780a72 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518048.880720:0:6645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0790a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627422720:0@lo:501: 00000100:00100000:3.0:1789518048.880744:0:6645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518048.880773:0:6645:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc76c4540 going to sleep for 11 seconds 00000100:00100000:2.0:1789518048.880779:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627422720 00000100:00100000:2.0:1789518048.880783:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627422720 00000100:00100000:2.0:1789518048.880812:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789518048.880818:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+12:6645:x1876445627422720:12345-0@lo:501: 00000100:00100000:1.0:1789518048.880982:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:824c8f07-28fa-48fd-81af-173b194570e6:3283:1876445627422464:0@lo:103: 00000100:00100000:0.0:1789518048.881059:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4001500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:824c8f07-28fa-48fd-81af-173b194570e6+12:3283:x1876445627422464:12345-0@lo:103: Request processed in 931us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518048.881065:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789518048.881078:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+12:6645:x1876445627422720:12345-0@lo:501: Request processed in 261us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518048.881084:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789518048.881138:0:6645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0790a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627422720:0@lo:501: 00000100:00100000:3.0:1789518048.881171:0:6645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0790a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627422848:0@lo:503: 00000100:00100000:3.0:1789518048.881201:0:6645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518048.881217:0:6645:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc76c4540 going to sleep for 11 seconds 00000100:00100000:2.0:1789518048.881302:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627422848 00000100:00100000:2.0:1789518048.881306:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627422848 00000100:00100000:2.0:1789518048.881334:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789518048.881341:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+12:6645:x1876445627422848:12345-0@lo:503: 00000100:00100000:2.0:1789518048.881544:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+12:6645:x1876445627422848:12345-0@lo:503: Request processed in 203us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518048.881551:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789518048.881604:0:6645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0790a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627422848:0@lo:503: 00000040:00080000:1.0:1789518048.881908:0:6645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789518048.881959:0:6645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4002300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627422976:0@lo:502: 00000100:00100000:1.0:1789518048.881983:0:6645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518048.882049:0:6645:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffdb5dc6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518048.882087:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627422976 00000100:00100000:2.0:1789518048.882091:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627422976 00000100:00100000:2.0:1789518048.882121:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789518048.882127:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+11:6645:x1876445627422976:12345-0@lo:502: 00000100:00100000:2.0:1789518048.882367:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+11:6645:x1876445627422976:12345-0@lo:502: Request processed in 239us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518048.882373:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789518048.882446:0:6645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4002300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627422976:0@lo:502: 00000040:00080000:1.0:1789518048.882678:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789518048.882724:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789518048.882762:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789518048.882810:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789518048.882848:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789518048.882883:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789518048.882905:0:6645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4002300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627423104:0@lo:502: 00000100:00100000:1.0:1789518048.882937:0:6645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518048.882959:0:6645:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffdb5dc6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518048.882973:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627423104 00000100:00100000:1.0:1789518048.882977:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627423104 00000100:00100000:1.0:1789518048.883202:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789518048.883210:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+11:6645:x1876445627423104:12345-0@lo:502: 00000100:00100000:1.0:1789518048.883461:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+11:6645:x1876445627423104:12345-0@lo:502: Request processed in 250us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518048.883480:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789518048.883537:0:6645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4002300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627423104:0@lo:502: 00000040:00080000:2.0:1789518048.883663:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1789518048.883676:0:6645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1789518048.884053:0:6665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789518048.884059:0:6665:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1789518048.884064:0:6665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518048.884065:0:6665:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789518048.884139:0:6665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789518048.884150:0:6665:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff99fff4203380) 00000020:00000080:2.0:1789518048.884163:0:6665:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789518048.884167:0:6665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789518048.884227:0:6665:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ffc76f3000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789518048.884234:0:6665:0:(osd_handler.c:1614:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789518048.884240:0:6665:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x631fd8698c780a80 00010000:00010000:2.0:1789518048.887572:0:6665:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1789518048.887852:0:6665:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1789518048.890170:0:6665:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789518048.890419:0:6665:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1789518048.900748:0:6665:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1789518048.901410:0:6665:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1789518048.904407:0:6665:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789518048.904418:0:6665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518048.904424:0:6665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518048.904426:0:6665:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789518048.904429:0:6665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518048.904446:0:6665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518048.904447:0:6665:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789518048.904451:0:6665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789518048.904453:0:6665:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789518048.904499:0:6665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518048.904502:0:6665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518048.904503:0:6665:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789518048.904506:0:6665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1789518048.904661:0:6645:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1789518048.904681:0:6645:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789518048.904700:0:6645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9a00021c6000/0x631fd8698c780a6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780a72 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.904713:0:6645:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9a00021c6000/0x631fd8698c780a6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780a72 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518048.904719:0:6645:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ffc76f3000 from 1 10000000:01000000:2.0:1789518048.904720:0:6645:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789518048.904745:0:6645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9800/0x631fd8698c780a87 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.904750:0:6645:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9800/0x631fd8698c780a87 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.904757:0:6645:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9800/0x631fd8698c780a87 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518048.904771:0:6645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627423232:0@lo:101: 00000100:00100000:2.0:1789518048.904817:0:6645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518048.904856:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627423232 00000100:00100000:3.0:1789518048.904862:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627423232 00000100:00100000:3.0:1789518048.904897:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789518048.904905:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+11:6645:x1876445627423232:12345-0@lo:101: 00010000:00010000:3.0:1789518048.904916:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518048.904927:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a00021c6c00/0x631fd8698c780a8e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780a87 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518048.904947:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a00021c6c00/0x631fd8698c780a8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780a87 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518048.904957:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a00021c6c00/0x631fd8698c780a8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780a87 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518048.904965:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6c00, rc 0) 00000100:00100000:3.0:1789518048.904997:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+12:6645:x1876445627423232:12345-0@lo:101: Request processed in 93us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518048.905011:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789518048.905056:0:6645:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd2bd7600 going to sleep for 11 seconds 00000100:00100000:2.0:1789518048.905076:0:6645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627423232:0@lo:101: 00010000:00010000:2.0:1789518048.905088:0:6645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9800/0x631fd8698c780a87 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780a8e expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.905097:0:6645:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9800/0x631fd8698c780a87 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780a8e expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518048.905157:0:6645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627423360:0@lo:501: 00000100:00100000:2.0:1789518048.905181:0:6645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518048.905203:0:6645:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd2bd7600 going to sleep for 11 seconds 00000100:00100000:0.0:1789518048.905268:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627423360 00000100:00100000:0.0:1789518048.905273:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627423360 00000100:00100000:0.0:1789518048.905303:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789518048.905314:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+12:6645:x1876445627423360:12345-0@lo:501: 00000100:00100000:0.0:1789518048.905509:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+12:6645:x1876445627423360:12345-0@lo:501: Request processed in 194us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518048.905516:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789518048.905575:0:6645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627423360:0@lo:501: 00000100:00100000:2.0:1789518048.905597:0:6645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627423488:0@lo:503: 00000100:00100000:2.0:1789518048.905654:0:6645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518048.905668:0:6645:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd2bd7600 going to sleep for 11 seconds 00000100:00100000:0.0:1789518048.905720:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627423488 00000100:00100000:0.0:1789518048.905724:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627423488 00000100:00100000:0.0:1789518048.905746:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789518048.905752:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+12:6645:x1876445627423488:12345-0@lo:503: 00000100:00100000:0.0:1789518048.906042:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+12:6645:x1876445627423488:12345-0@lo:503: Request processed in 290us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518048.906049:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789518048.906115:0:6645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627423488:0@lo:503: 00000040:00080000:2.0:1789518048.906331:0:6645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789518048.906377:0:6645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627423616:0@lo:502: 00000100:00100000:2.0:1789518048.906411:0:6645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518048.906446:0:6645:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd2bd7600 going to sleep for 11 seconds 00000100:00100000:0.0:1789518048.906487:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627423616 00000100:00100000:0.0:1789518048.906492:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627423616 00000100:00100000:0.0:1789518048.906522:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789518048.906528:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+12:6645:x1876445627423616:12345-0@lo:502: 00000100:00100000:0.0:1789518048.906763:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+12:6645:x1876445627423616:12345-0@lo:502: Request processed in 234us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518048.906770:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789518048.906832:0:6645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627423616:0@lo:502: 00000040:00080000:3.0:1789518048.907261:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789518048.907308:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789518048.907330:0:6645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0790000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627423744:0@lo:502: 00000100:00100000:3.0:1789518048.907364:0:6645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518048.907440:0:6645:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6154780 going to sleep for 11 seconds 00000100:00100000:2.0:1789518048.907546:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627423744 00000100:00100000:2.0:1789518048.907551:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627423744 00000100:00100000:2.0:1789518048.907627:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789518048.907634:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+12:6645:x1876445627423744:12345-0@lo:502: 00000100:00100000:2.0:1789518048.907756:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+12:6645:x1876445627423744:12345-0@lo:502: Request processed in 122us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518048.907763:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789518048.907834:0:6645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0790000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627423744:0@lo:502: 00000040:00080000:3.0:1789518048.908059:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789518048.908068:0:6645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1789518048.908390:0:6669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789518048.908398:0:6669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518048.908400:0:6669:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789518048.908405:0:6669:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ffc76f3000 00000020:00000080:2.0:1789518048.908407:0:6669:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789518048.908421:0:6669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789518048.908423:0:6669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518048.908425:0:6669:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789518048.908427:0:6669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789518048.908552:0:6645:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789518048.908568:0:6645:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789518048.908627:0:6645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9800/0x631fd8698c780a87 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780a8e expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518048.908637:0:6645:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9800/0x631fd8698c780a87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780a8e expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518048.908671:0:6645:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789518048.908674:0:6645:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99ffc76f3000 10000000:01000000:3.0:1789518048.908677:0:6645:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99ffc76f3000 10000000:01000000:3.0:1789518048.908680:0:6645:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789518048.908685:0:6645:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99ffc76f3000 from 1 10000000:01000000:3.0:1789518048.908687:0:6645:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789518048.908707:0:6645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9a00021c7000/0x631fd8698c780a95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518048.908716:0:6645:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9a00021c7000/0x631fd8698c780a95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518048.908730:0:6645:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9a00021c7000/0x631fd8698c780a95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518048.908743:0:6645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0790000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627423872:0@lo:101: 00000100:00100000:3.0:1789518048.908771:0:6645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518048.908794:0:6645:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6154840 going to sleep for 11 seconds 00000100:00100000:0.0:1789518048.910140:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627423872 00000100:00100000:0.0:1789518048.910149:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627423872 00000100:00100000:0.0:1789518048.910193:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789518048.910202:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+12:6645:x1876445627423872:12345-0@lo:101: 00010000:00010000:0.0:1789518048.910213:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518048.910225:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc0030800/0x631fd8698c780a9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780a95 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518048.910245:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc0030800/0x631fd8698c780a9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780a95 expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518048.910263:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc0030800/0x631fd8698c780a9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780a95 expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518048.910271:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc0030800, rc 0) 00000100:00100000:0.0:1789518048.910324:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+13:6645:x1876445627423872:12345-0@lo:101: Request processed in 123us (1551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518048.910331:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789518048.910422:0:6645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0790000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627423872:0@lo:101: 00010000:00010000:2.0:1789518048.910446:0:6645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9a00021c7000/0x631fd8698c780a95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780a9c expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.910461:0:6645:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9a00021c7000/0x631fd8698c780a95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780a9c expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518048.910534:0:6645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627424000:0@lo:501: 00000100:00100000:2.0:1789518048.910561:0:6645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518048.910593:0:6645:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc4fc0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789518048.910666:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627424000 00000100:00100000:3.0:1789518048.910671:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627424000 00000100:00100000:3.0:1789518048.910690:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789518048.910696:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+13:6645:x1876445627424000:12345-0@lo:501: 00000100:00100000:3.0:1789518048.910898:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+13:6645:x1876445627424000:12345-0@lo:501: Request processed in 201us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518048.910905:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789518048.911008:0:6645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627424000:0@lo:501: 00000100:00100000:2.0:1789518048.911032:0:6645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627424128:0@lo:503: 00000100:00100000:2.0:1789518048.911066:0:6645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518048.911090:0:6645:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc4fc0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518048.911359:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627424128 00000100:00100000:0.0:1789518048.911364:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627424128 00000100:00100000:0.0:1789518048.911392:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789518048.911399:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc777b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+13:6645:x1876445627424128:12345-0@lo:503: 00000100:00100000:0.0:1789518048.911539:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc777b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+13:6645:x1876445627424128:12345-0@lo:503: Request processed in 140us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518048.911546:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789518048.911580:0:6645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627424128:0@lo:503: 00000040:00080000:0.0:1789518048.911843:0:6645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789518048.911889:0:6645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6501f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627424256:0@lo:502: 00000100:00100000:0.0:1789518048.911920:0:6645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518048.911934:0:6645:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc516cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789518048.911946:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627424256 00000100:00100000:0.0:1789518048.911950:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627424256 00000100:00100000:0.0:1789518048.911966:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789518048.911971:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc777bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+13:6645:x1876445627424256:12345-0@lo:502: 00000100:00100000:0.0:1789518048.912111:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc777bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+13:6645:x1876445627424256:12345-0@lo:502: Request processed in 139us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518048.912117:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789518048.912160:0:6645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6501f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627424256:0@lo:502: 00000040:00080000:2.0:1789518048.912383:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789518048.912429:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789518048.912478:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789518048.912517:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789518048.912547:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789518048.912586:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789518048.912634:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789518048.912665:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789518048.912704:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789518048.912734:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789518048.912762:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789518048.912803:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789518048.912845:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789518048.913061:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789518048.913102:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789518048.913133:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789518048.913171:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789518048.913213:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789518048.913243:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789518048.913271:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789518048.913314:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789518048.913347:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789518048.913379:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789518048.913421:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789518048.913472:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1789518048.913502:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1789518048.913545:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1789518048.913578:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1789518048.913604:0:6645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627424384:0@lo:502: 00000100:00100000:2.0:1789518048.913664:0:6645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518048.913690:0:6645:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc4fc0540 going to sleep for 11 seconds 00000100:00100000:1.0:1789518048.913771:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627424384 00000100:00100000:1.0:1789518048.913777:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627424384 00000100:00100000:1.0:1789518048.913830:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789518048.913837:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc777a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+13:6645:x1876445627424384:12345-0@lo:502: 00000100:00100000:1.0:1789518048.914000:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc777a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+13:6645:x1876445627424384:12345-0@lo:502: Request processed in 163us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518048.914007:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789518048.914074:0:6645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627424384:0@lo:502: 00000040:00080000:2.0:1789518048.914129:0:6645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1789518048.914139:0:6645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1789518048.914533:0:6670:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789518048.914549:0:6670:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff99ffffa53380) 00000020:00000080:0.0:1789518048.914567:0:6670:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1789518048.914696:0:6670:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ffc76f3000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789518048.914700:0:6670:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ffc76f3000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789518048.914703:0:6670:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffc76f3000 3 00010000:00080000:0.0:1789518048.914735:0:6670:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ffffa5b800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.151@tcp at head 00010000:00010000:0.0:1789518048.916247:0:6670:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1789518048.916483:0:6670:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789518048.916511:0:6670:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789518048.916521:0:6670:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x631fd8698c780aaa 00000100:00080000:0.0:1789518048.916527:0:6670:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789518048.916535:0:6670:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99ffffa5b800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1789518048.916562:0:6670:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffc6503b80 x1876445627424512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789518048.916587:0:6670:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000040:00080000:0.0:1789518048.916801:0:6670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:3.0:1789518048.916890:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3279:1876445627424512:0@lo:38: 00000100:00100000:2.0:1789518048.917034:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789518048.917044:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876445627424640:0@lo:400: 00000100:00100000:3.0:1789518048.917118:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1789518048.917126:0:6645:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1789518048.917149:0:6645:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789518048.917161:0:6645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9a00021c7000/0x631fd8698c780a95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780a9c expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.917171:0:6645:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9a00021c7000/0x631fd8698c780a95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780a9c expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518048.917172:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1789518048.917222:0:6645:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789518048.917224:0:6645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789518048.917228:0:6645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789518048.917229:0:6645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789518048.917231:0:6645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789518048.917232:0:6645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789518048.917233:0:6645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789518048.917234:0:6645:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789518048.917235:0:6645:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789518048.917237:0:6645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789518048.917238:0:6645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789518048.917241:0:6645:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1789518048.917243:0:6645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789518048.917245:0:6645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789518048.917245:0:6645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789518048.917246:0:6645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789518048.917247:0:6645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789518048.917248:0:6645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789518048.917249:0:6645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789518048.917250:0:6645:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789518048.917251:0:6645:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789518048.917252:0:6645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789518048.917253:0:6645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789518048.917266:0:6645:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789518048.917274:0:6645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627424768:0@lo:253: 00000100:00100000:2.0:1789518048.917297:0:6645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518048.917334:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627424512 00000100:00100000:0.0:1789518048.917343:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627424512 00000100:00100000:0.0:1789518048.917365:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627424640 00000100:00100000:0.0:1789518048.917368:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627424640 00000100:00100000:0.0:1789518048.917387:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789518048.917393:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876445627424640:12345-0@lo:400: 00000100:00100000:0.0:1789518048.917452:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876445627424640:12345-0@lo:400: Request processed in 58us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518048.917458:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789518048.917469:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789518048.917472:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3279:x1876445627424512:12345-0@lo:38: 00010000:00080000:0.0:1789518048.917486:0:5812:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 102 last 0 00000020:00000080:0.0:1789518048.917511:0:5812:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x631fd8698c780ab1 00000004:00100000:0.0:1789518048.917522:0:5812:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789518048.917541:0:5812:0:(import.c:65:import_set_state_nolock()) ffff99ffffa58000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789518048.917570:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876445627424512:12345-0@lo:38: Request processed in 96us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518048.917575:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789518048.917607:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99ffd846ce00 x1876445627424640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518048.917636:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876445627424640:0@lo:400: 00010000:00080000:0.0:1789518048.917659:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99ffc6503b80 x1876445627424512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789518058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518048.917666:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789518048.917670:0:3279:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1789518048.917675:0:3279:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789518048.917678:0:3279:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789518048.917680:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffffa5b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789518048.917684:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3279:1876445627424512:0@lo:38: 00000100:00100000:2.0:1789518048.918146:0:6645:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc4fc0540 going to sleep for 11 seconds 00000100:00100000:3.0:1789518048.918175:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627424768 00000100:00100000:3.0:1789518048.918179:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627424768 00000100:00100000:3.0:1789518048.918211:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789518048.918218:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7779c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+13:6645:x1876445627424768:12345-0@lo:253: 20000000:01000000:3.0:1789518048.918235:0:5807:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789518048.918246:0:5807:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789518048.937211:0:5807:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789518048.937229:0:5807:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789518048.937295:0:5827:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789518048.937300:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789518048.937320:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780ab8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518048.937337:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffc0031800/0x631fd8698c780a1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780a17 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518048.937346:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780ab8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518048.937399:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffc0031800/0x631fd8698c780a1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c780a17 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518048.937412:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffc0031800/0x631fd8698c780a1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c780a17 expref: 13 pid: 5807 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518048.937424:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6503b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5827:1876445627424896:0@lo:104: 00000100:00100000:0.0:1789518048.937491:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518048.937533:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc516c840 going to sleep for 11 seconds 00000100:00100000:2.0:1789518048.937578:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627424896 00000100:00100000:2.0:1789518048.937586:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627424896 00000100:00100000:2.0:1789518048.937665:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789518048.937674:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6500700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:824c8f07-28fa-48fd-81af-173b194570e6+3:5827:x1876445627424896:12345-0@lo:104: 00010000:00010000:2.0:1789518048.937686:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9a00/0x631fd8698c780a17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780a1e expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.937746:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789518048.937751:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6500700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:824c8f07-28fa-48fd-81af-173b194570e6+3:5827:x1876445627424896:12345-0@lo:104: Request processed in 79us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518048.937776:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1789518048.937795:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518048.937801:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9a00/0x631fd8698c780a17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780a1e expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.937807:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29c9a00 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:2.0:1789518048.937810:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9a00/0x631fd8698c780a17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c780a1e expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.937818:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9a00/0x631fd8698c780a17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c780a1e expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518048.937826:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9a00/0x631fd8698c780a17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c780a1e expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518048.937832:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789518048.937856:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9a00/0x631fd8698c780a17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780a1e expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.937863:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789518048.937878:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9a00/0x631fd8698c780a17 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780a1e expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.937884:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9a00/0x631fd8698c780a17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780a1e expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.937902:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518048.937904:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518048.937906:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518048.937916:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:824c8f07-28fa-48fd-81af-173b194570e6:3281:1876445627425024:0@lo:103: 00000100:00100000:2.0:1789518048.937949:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518048.937982:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627425024 00000100:00100000:2.0:1789518048.937986:0:5798:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627425024 00010000:00010000:2.0:1789518048.938001:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffc0031800/0x631fd8698c780a1e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780a17 expref: 14 pid: 5807 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518048.938027:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789518048.938033:0:5798:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd8067c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:824c8f07-28fa-48fd-81af-173b194570e6+14:3281:x1876445627425024:12345-0@lo:103: 00010000:00010000:2.0:1789518048.938042:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518048.938047:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffc0031800/0x631fd8698c780a1e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780a17 expref: 14 pid: 5807 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.938057:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffc0031800/0x631fd8698c780a1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c780a17 expref: 14 pid: 5807 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.938070:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780ab8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.938077:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780ab8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789518048.938089:0:5798:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001467063s 00010000:00010000:2.0:1789518048.938094:0:5798:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780ab8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.938101:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780ab8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.938108:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780ab8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.938124:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780ab8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.938129:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc0030a00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518048.938133:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780ab8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.938140:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780ab8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.938148:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780ab8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.938157:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518048.938185:0:5798:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd8067c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:824c8f07-28fa-48fd-81af-173b194570e6+14:3281:x1876445627425024:12345-0@lo:103: Request processed in 152us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518048.938191:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789518048.938255:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:824c8f07-28fa-48fd-81af-173b194570e6:3281:1876445627425024:0@lo:103: 00010000:00010000:2.0:1789518048.938278:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc0031800/0x631fd8698c780a1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c780a17 expref: 13 pid: 5807 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518048.938289:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6503b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5827:1876445627424896:0@lo:104: 00010000:00010000:2.0:1789518048.938302:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780ab8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.938311:0:5827:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780ab8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.938317:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780ab8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518048.938328:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780ab8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518048.944455:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7779c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+12:6645:x1876445627424768:12345-0@lo:253: Request processed in 26229us (27147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518048.944468:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789518048.944561:0:6645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:6645:1876445627424768:0@lo:253: 10000000:01000000:0.0:1789518048.944575:0:6645:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789518048.944578:0:6645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789518048.944580:0:6645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789518048.944581:0:6645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789518048.944583:0:6645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789518048.944584:0:6645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789518048.944585:0:6645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789518048.944586:0:6645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789518048.944588:0:6645:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789518048.944589:0:6645:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789518048.944590:0:6645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789518048.944591:0:6645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789518048.944603:0:6645:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789518048.950481:0:6645:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789518048.950761:0:6645:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789518048.950956:0:6645:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789518048.951116:0:6645:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789518048.951315:0:6645:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789518048.951559:0:6645:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789518048.953714:0:6645:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1789518049.095245:0:6645:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789518049.095251:0:6645:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789518049.095296:0:6645:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789518049.095349:0:6645:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.151@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789518049.095363:0:6645:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789518049.095384:0:6645:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1789518049.714776:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518050.739062:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518051.762698:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789518052.154196:0:7013:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789518052.789238:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518053.814102:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518054.006461:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:824c8f07-28fa-48fd-81af-173b194570e6:3282:1876445627425152:0@lo:400: 00000100:00100000:0.0:1789518054.006526:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518054.006707:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627425152 00000100:00100000:1.0:1789518054.006716:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627425152 00000100:00100000:1.0:1789518054.006769:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789518054.006779:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+12:3282:x1876445627425152:12345-0@lo:400: 00000100:00100000:3.0:1789518054.007604:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627425280:0@lo:400: 00000100:00100000:3.0:1789518054.007675:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518054.007736:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627425280 00000100:00100000:3.0:1789518054.007741:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627425280 00000100:00100000:3.0:1789518054.007782:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789518054.007789:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627425280:12345-0@lo:400: 00000100:00100000:3.0:1789518054.007826:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627425280:12345-0@lo:400: Request processed in 38us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518054.007833:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789518054.007868:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffd846d500 x1876445627425280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518054.007881:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627425280:0@lo:400: 00000100:00100000:1.0:1789518054.008761:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+12:3282:x1876445627425152:12345-0@lo:400: Request processed in 1980us (2231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518054.008770:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789518054.008783:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789518054.008796:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627425408:0@lo:400: 00000100:00100000:2.0:1789518054.008831:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518054.008884:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627425408 00000100:00100000:1.0:1789518054.008889:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627425408 00000100:00100000:1.0:1789518054.008935:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789518054.008944:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:824c8f07-28fa-48fd-81af-173b194570e6:3282:1876445627425152:0@lo:400: 00000100:00100000:1.0:1789518054.008945:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627425408:12345-0@lo:400: 00000100:00080000:2.0:1789518054.009025:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518054.009141:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627425408:12345-0@lo:400: Request processed in 198us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518054.009147:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789518054.009265:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffd846e300 x1876445627425408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518054.009275:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627425408:0@lo:400: 00010000:00010000:2.0:1789518054.834733:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518055.859728:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518056.883773:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789518057.074931:0:5810:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789518057.074939:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99ffc84db000 from 21 10000000:01000000:3.0:1789518057.074946:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789518057.075105:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9a00021c7200/0x631fd8698c780abf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518057.075118:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9a00021c7200/0x631fd8698c780abf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518057.075132:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9a00021c7200/0x631fd8698c780abf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518057.075162:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0793b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627425536:0@lo:101: 00000100:00100000:3.0:1789518057.075233:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518057.075305:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffff76f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518057.075314:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627425536 00000100:00100000:0.0:1789518057.075326:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627425536 00000100:00100000:0.0:1789518057.075415:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789518057.075428:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc777a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+12:5810:x1876445627425536:12345-0@lo:101: 00010000:00010000:0.0:1789518057.075445:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518057.075463:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc0031800/0x631fd8698c780ac6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780abf expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518057.075490:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc0031800/0x631fd8698c780ac6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780abf expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518057.075501:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc0031800/0x631fd8698c780ac6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780abf expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518057.075509:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc0031800, rc 0) 00000100:00100000:0.0:1789518057.075578:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc777a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+13:5810:x1876445627425536:12345-0@lo:101: Request processed in 156us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518057.075583:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789518057.075771:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0793b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627425536:0@lo:101: 00010000:00010000:3.0:1789518057.075794:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9a00021c7200/0x631fd8698c780abf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780ac6 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518057.075806:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9a00021c7200/0x631fd8698c780abf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780ac6 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518057.075883:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0793b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627425664:0@lo:501: 00000100:00100000:3.0:1789518057.075918:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518057.075958:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffff76f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518057.075972:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627425664 00000100:00100000:0.0:1789518057.075980:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627425664 00000100:00100000:0.0:1789518057.076009:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789518057.076018:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7779450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+13:5810:x1876445627425664:12345-0@lo:501: 00000100:00100000:0.0:1789518057.076516:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7779450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+13:5810:x1876445627425664:12345-0@lo:501: Request processed in 499us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518057.076529:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789518057.076719:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0793b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627425664:0@lo:501: 00000100:00100000:3.0:1789518057.076766:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0793b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627425792:0@lo:503: 00000100:00100000:3.0:1789518057.076813:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518057.076890:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffff76f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518057.076931:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627425792 00000100:00100000:0.0:1789518057.076936:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627425792 00000100:00100000:0.0:1789518057.077007:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789518057.077015:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7778c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+13:5810:x1876445627425792:12345-0@lo:503: 00000100:00100000:0.0:1789518057.077667:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7778c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+13:5810:x1876445627425792:12345-0@lo:503: Request processed in 652us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518057.077675:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789518057.077932:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0793b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627425792:0@lo:503: 00000100:00100000:1.0:1789518057.078115:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4000380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:7455:1876445627425920:0@lo:502: 00000100:00100000:1.0:1789518057.078160:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518057.078185:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8454840 going to sleep for 11 seconds 00000100:00100000:3.0:1789518057.078204:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627425920 00000100:00100000:3.0:1789518057.078211:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627425920 00000100:00100000:3.0:1789518057.078246:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789518057.078253:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7778050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+13:7455:x1876445627425920:12345-0@lo:502: 00000100:00100000:2.0:1789518057.078996:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4000380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:7455:1876445627425920:0@lo:502: 00000100:00100000:3.0:1789518057.078997:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7778050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+13:7455:x1876445627425920:12345-0@lo:502: Request processed in 741us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518057.079010:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789518057.079081:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0792d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:7455:1876445627426048:0@lo:502: 00000100:00100000:3.0:1789518057.079115:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518057.079221:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffff76fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789518057.079560:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627426048 00000100:00100000:0.0:1789518057.079565:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627426048 00000100:00100000:0.0:1789518057.079670:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789518057.079679:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7778450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+13:7455:x1876445627426048:12345-0@lo:502: 00000100:00100000:0.0:1789518057.079861:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7778450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+13:7455:x1876445627426048:12345-0@lo:502: Request processed in 183us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518057.079867:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789518057.079928:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0792d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:7455:1876445627426048:0@lo:502: 00000040:00080000:3.0:1789518057.079949:0:7455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1789518057.080081:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1789518057.080101:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789518057.080115:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9a00021c7200/0x631fd8698c780abf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780ac6 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518057.080125:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9a00021c7200/0x631fd8698c780abf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780ac6 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518057.080133:0:5810:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789518057.080136:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99ffc84db000 from 4 10000000:01000000:2.0:1789518057.080138:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789518057.080161:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8600/0x631fd8698c780acd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518057.080168:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8600/0x631fd8698c780acd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518057.080176:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8600/0x631fd8698c780acd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518057.080186:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627426176:0@lo:101: 00000100:00100000:2.0:1789518057.080215:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518057.080235:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc2d02d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789518057.080248:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627426176 00000100:00100000:2.0:1789518057.080252:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627426176 00000100:00100000:2.0:1789518057.080282:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789518057.080289:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc777b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+13:5810:x1876445627426176:12345-0@lo:101: 00010000:00010000:2.0:1789518057.080298:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518057.080309:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc29c8400/0x631fd8698c780ad4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780acd expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518057.080329:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc29c8400/0x631fd8698c780ad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780acd expref: 14 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518057.080345:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc29c8400/0x631fd8698c780ad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780acd expref: 14 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518057.080352:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29c8400, rc 0) 00000100:00100000:2.0:1789518057.080849:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc777b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+14:5810:x1876445627426176:12345-0@lo:101: Request processed in 559us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518057.080857:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789518057.081908:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627426176:0@lo:101: 00010000:00010000:3.0:1789518057.081924:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8600/0x631fd8698c780acd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780ad4 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518057.081932:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8600/0x631fd8698c780acd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780ad4 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518057.081979:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0792d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627426304:0@lo:256: 00000100:00100000:3.0:1789518057.082115:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518057.082152:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffff76fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789518057.082379:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627426304 00000100:00100000:2.0:1789518057.082383:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627426304 00000100:00100000:2.0:1789518057.082424:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789518057.082433:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+14:5810:x1876445627426304:12345-0@lo:256: 20000000:01000000:2.0:1789518057.082449:0:5805:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789518057.082464:0:5805:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789518057.082467:0:5805:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1789518057.082541:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+14:5810:x1876445627426304:12345-0@lo:256: Request processed in 110us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518057.082548:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789518057.082560:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0792d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627426304:0@lo:256: 10000000:01000000:3.0:1789518057.082602:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789518057.082608:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8600/0x631fd8698c780acd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780ad4 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518057.082648:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8600/0x631fd8698c780acd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780ad4 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518057.082656:0:5810:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789518057.082658:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1789518057.082661:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789518057.082679:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9a00021c6a00/0x631fd8698c780adb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518057.082687:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9a00021c6a00/0x631fd8698c780adb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518057.082694:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9a00021c6a00/0x631fd8698c780adb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518057.082706:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0792d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627426432:0@lo:101: 00000100:00100000:3.0:1789518057.082730:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518057.082768:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627426432 00000100:00100000:2.0:1789518057.082773:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627426432 00000100:00100000:2.0:1789518057.082793:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789518057.082800:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7779050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+14:5810:x1876445627426432:12345-0@lo:101: 00010000:00010000:2.0:1789518057.082812:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518057.082823:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc29c9400/0x631fd8698c780ae2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780adb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518057.082839:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc29c9400/0x631fd8698c780ae2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780adb expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518057.082860:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc29c9400/0x631fd8698c780ae2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780adb expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518057.082868:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29c9400, rc 0) 00000100:00100000:3.0:1789518057.082960:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffff76fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789518057.082968:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7779050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+15:5810:x1876445627426432:12345-0@lo:101: Request processed in 166us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518057.082975:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0792d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627426432:0@lo:101: 00000100:00100000:2.0:1789518057.082976:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00010000:3.0:1789518057.083065:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9a00021c6a00/0x631fd8698c780adb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780ae2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518057.083075:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9a00021c6a00/0x631fd8698c780adb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780ae2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518057.083115:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0792d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627426560:0@lo:501: 00000100:00100000:3.0:1789518057.083136:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518057.083150:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffff76fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789518057.083171:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627426560 00000100:00100000:2.0:1789518057.083182:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627426560 00000100:00100000:2.0:1789518057.083208:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789518057.083215:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc777a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+15:5810:x1876445627426560:12345-0@lo:501: 00000100:00100000:2.0:1789518057.083451:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc777a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+15:5810:x1876445627426560:12345-0@lo:501: Request processed in 235us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518057.083457:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789518057.083899:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0792d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627426560:0@lo:501: 00000100:00100000:3.0:1789518057.083929:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0792d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627426688:0@lo:503: 00000100:00100000:3.0:1789518057.083967:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518057.084008:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffff76fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789518057.084134:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627426688 00000100:00100000:2.0:1789518057.084139:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627426688 00000100:00100000:2.0:1789518057.084215:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789518057.084222:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc777ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+15:5810:x1876445627426688:12345-0@lo:503: 00000100:00100000:2.0:1789518057.084521:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc777ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+15:5810:x1876445627426688:12345-0@lo:503: Request processed in 299us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518057.084529:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789518057.084552:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0792d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627426688:0@lo:503: 00000100:00100000:3.0:1789518057.084809:0:7457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0792d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:7457:1876445627426816:0@lo:502: 00000100:00100000:3.0:1789518057.084849:0:7457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518057.084866:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627426816 00000100:00100000:3.0:1789518057.084871:0:7457:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffff76fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1789518057.084873:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627426816 00000100:00100000:0.0:1789518057.084909:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789518057.084916:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc777b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+15:7457:x1876445627426816:12345-0@lo:502: 00000100:00100000:0.0:1789518057.085111:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc777b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+15:7457:x1876445627426816:12345-0@lo:502: Request processed in 195us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518057.085118:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789518057.085324:0:7457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0792d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:7457:1876445627426816:0@lo:502: 00000020:01000000:3.0:1789518057.085519:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789518057.085526:0:7457:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789518057.085532:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518057.085535:0:7457:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789518057.085540:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789518057.085545:0:7457:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:01000000:3.0:1789518057.085571:0:7457:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789518057.085575:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789518057.085593:0:7457:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99ffc64a19c0) 00000020:00000080:3.0:1789518057.085633:0:7457:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1789518057.085642:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789518057.085706:0:7457:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789518057.085712:0:7457:0:(osd_handler.c:1614:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789518057.085720:0:7457:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c780af0 00010000:00080000:3.0:1789518057.085747:0:7457:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ffffbf7800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:3.0:1789518057.086548:0:7457:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1789518057.114915:0:7457:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789518057.114932:0:7457:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789518057.115764:0:7457:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789518057.116007:0:7457:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789518057.116070:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1789518057.116135:0:7457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1789518057.116830:0:7463:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789518057.116835:0:7463:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789518057.117338:0:7457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789518057.117350:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789518057.117380:0:7457:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789518057.117411:0:7457:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x631fd8698c780af7 00000100:00080000:3.0:1789518057.117421:0:7457:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789518057.117432:0:7457:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99ffffbf7800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1789518057.117464:0:7457:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffd0792d80 x1876445627426944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789518057.117492:0:7457:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1789518057.117538:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0792d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627426944:0@lo:8: 00000020:01000000:3.0:1789518057.117585:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518057.117590:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518057.117592:0:7457:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789518057.117595:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518057.117600:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518057.117601:0:7457:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789518057.117604:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000100:00100000:0.0:1789518057.117604:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1789518057.117606:0:7457:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789518057.117655:0:7457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0792680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:7457:1876445627427072:0@lo:502: 00000100:00100000:1.0:1789518057.117677:0:6647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627426944 00000100:00100000:1.0:1789518057.117684:0:6647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627426944 00000100:00100000:3.0:1789518057.117697:0:7457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518057.117719:0:7457:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffff76f480 going to sleep for 11 seconds 00000100:00100000:1.0:1789518057.117720:0:6647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789518057.117729:0:6647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3279:x1876445627426944:12345-0@lo:8: 00000100:00100000:3.0:1789518057.117743:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627427072 00000100:00100000:3.0:1789518057.117749:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627427072 00010000:00080000:1.0:1789518057.117750:0:6647:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 111 last 0 00000020:00000080:1.0:1789518057.117778:0:6647:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x631fd8698c780afe 00000100:00100000:3.0:1789518057.117791:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789518057.117800:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc8101c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+15:7457:x1876445627427072:12345-0@lo:502: 00002000:00100000:1.0:1789518057.117804:0:6647:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99ffff795000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789518057.117809:0:6647:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1789518057.117813:0:6647:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1789518057.118022:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789518057.118030:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627427200:0@lo:400: 00000100:00100000:3.0:1789518057.118057:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc8101c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+15:7457:x1876445627427072:12345-0@lo:502: Request processed in 258us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518057.118057:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518057.118064:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789518057.118082:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627427328:0@lo:400: 00000100:00100000:2.0:1789518057.118102:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518057.118109:0:7457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0792680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:7457:1876445627427072:0@lo:502: 00000020:01000000:3.0:1789518057.118129:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518057.118134:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518057.118135:0:7457:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789518057.118139:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:2.0:1789518057.118142:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627427200 00000100:00100000:2.0:1789518057.118145:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627427200 00000100:00100000:2.0:1789518057.118167:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627427328 00000100:00100000:2.0:1789518057.118169:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627427328 00000100:00100000:2.0:1789518057.118191:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789518057.118197:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627427200:12345-0@lo:400: 00000100:00100000:2.0:1789518057.118232:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627427200:12345-0@lo:400: Request processed in 35us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518057.118238:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789518057.118251:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789518057.118257:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627427328:12345-0@lo:400: 00000100:00100000:2.0:1789518057.118284:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627427328:12345-0@lo:400: Request processed in 28us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518057.118289:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000000:3.0:1789518057.118302:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 00000100:00080000:2.0:1789518057.118307:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:3.0:1789518057.118317:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789518057.118326:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9a00021c6a00/0x631fd8698c780adb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780ae2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518057.118336:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9a00021c6a00/0x631fd8698c780adb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780ae2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1789518057.118339:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffd846d880 x1876445627427328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789518057.118346:0:5810:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789518057.118348:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99ffc64a4d40 from 1 00000100:00100000:2.0:1789518057.118349:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627427328:0@lo:400: 10000000:01000000:3.0:1789518057.118351:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00080000:2.0:1789518057.118372:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffd846c000 x1876445627427200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1789518057.118373:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff9a00021c6400/0x631fd8698c780b05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518057.118382:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627427200:0@lo:400: 00010000:00010000:3.0:1789518057.118403:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff9a00021c6400/0x631fd8698c780b05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518057.118414:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff9a00021c6400/0x631fd8698c780b05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518057.118427:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0792680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627427456:0@lo:101: 00002000:00100000:1.0:1789518057.118445:0:6647:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1789518057.118458:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518057.118485:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffff76f480 going to sleep for 11 seconds 00002000:00080000:1.0:1789518057.118563:0:6647:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789518057.118582:0:6647:0:(import.c:65:import_set_state_nolock()) ffff99ffff796800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789518057.118750:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627427456 00000100:00100000:2.0:1789518057.118754:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627427456 00000100:00100000:2.0:1789518057.118781:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789518057.118788:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc8103450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+15:5810:x1876445627427456:12345-0@lo:101: 00010000:00010000:2.0:1789518057.118796:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518057.118812:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc29c9a00/0x631fd8698c780b0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780b05 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518057.118856:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc29c9a00/0x631fd8698c780b0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780b05 expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518057.118866:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc29c9a00/0x631fd8698c780b0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780b05 expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518057.118874:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29c9a00, rc 0) 00000100:00100000:2.0:1789518057.118941:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc8103450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+16:5810:x1876445627427456:12345-0@lo:101: Request processed in 153us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518057.119061:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789518057.119094:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0792680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627427456:0@lo:101: 00010000:00010000:2.0:1789518057.119104:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff9a00021c6400/0x631fd8698c780b05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780b0c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518057.119231:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff9a00021c6400/0x631fd8698c780b05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780b0c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518057.119269:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627427584:0@lo:501: 00000100:00100000:2.0:1789518057.119290:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518057.119309:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffc27a180 going to sleep for 11 seconds 00000100:00100000:2.0:1789518057.119319:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627427584 00000100:00100000:2.0:1789518057.119322:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627427584 00000100:00100000:2.0:1789518057.119338:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789518057.119343:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc8103050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+16:5810:x1876445627427584:12345-0@lo:501: 00000100:00100000:1.0:1789518057.119493:0:6647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3279:x1876445627426944:12345-0@lo:8: Request processed in 1761us (1887us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518057.119502:0:6647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789518057.119531:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc8103050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+16:5810:x1876445627427584:12345-0@lo:501: Request processed in 185us (238us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789518057.119548:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789518057.119578:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627427584:0@lo:501: 10000000:01000000:2.0:1789518057.119595:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789518057.119601:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff9a00021c6400/0x631fd8698c780b05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780b0c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518057.119607:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff9a00021c6400/0x631fd8698c780b05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780b0c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1789518057.119825:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffd0792d80 x1876445627426944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789518067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518057.119831:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789518057.119836:0:3279:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789518057.119841:0:3279:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789518057.119845:0:3279:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789518057.119846:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffffbf7800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789518057.119866:0:3279:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789518057.119871:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0792d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627426944:0@lo:8: 00000004:00080000:2.0:1789518057.120034:0:7463:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789518057.120116:0:7463:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 111116501984ns, next at 0ns, rc = 0 00000004:00080000:0.0:1789518057.143518:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1789518057.143720:0:7464:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789518057.143728:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627427712:0@lo:13: 00000100:00100000:2.0:1789518057.143747:0:7464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7464:1876445627427840:0@lo:7: 00000100:00100000:0.0:1789518057.143799:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518057.143815:0:7464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518057.143853:0:7464:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8116d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789518057.143920:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627427712 00000100:00100000:1.0:1789518057.143927:0:6651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627427712 00000100:00080000:2.0:1789518057.143975:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518057.143985:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789518057.143995:0:6651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1876445627427712:12345-0@lo:13: 00002000:00000024:1.0:1789518057.144216:0:6651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1789518057.144481:0:6651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1876445627427712:12345-0@lo:13: Request processed in 486us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518057.144489:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789518057.144544:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffd846c000 x1876445627427712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518073 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518057.144563:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627427712:0@lo:13: 00000100:00100000:2.0:1789518057.145742:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627427840 00000100:00100000:2.0:1789518057.145750:0:6649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627427840 00000100:00100000:2.0:1789518057.145791:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789518057.145800:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7464:x1876445627427840:12345-0@lo:7: 00002000:00080000:2.0:1789518057.153382:0:6649:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1789518057.153400:0:6649:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789518057.153492:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7464:x1876445627427840:12345-0@lo:7: Request processed in 7689us (9674us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518057.153503:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789518057.153576:0:7464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffd846d880 x1876445627427840/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789518073 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518057.153592:0:7464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7464:1876445627427840:0@lo:7: 00000004:00080000:3.0:1789518057.153605:0:7464:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1789518057.153666:0:7464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0791f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7464:1876445627427968:0@lo:5: 00000100:00100000:3.0:1789518057.153698:0:7464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518057.153737:0:7464:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffff76fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789518057.153853:0:6647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627427968 00000100:00100000:2.0:1789518057.153869:0:6647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627427968 00000100:00100000:2.0:1789518057.153917:0:6647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789518057.153926:0:6647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7464:x1876445627427968:12345-0@lo:5: 00002000:00080000:2.0:1789518057.153948:0:6647:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789518057.153951:0:6647:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1789518057.154903:0:6647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7464:x1876445627427968:12345-0@lo:5: Request processed in 976us (1203us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789518057.154912:0:6647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789518057.155016:0:7464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffd0791f80 x1876445627427968/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789518073 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518057.155044:0:7464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0791f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7464:1876445627427968:0@lo:5: 00000004:00080000:3.0:1789518057.155057:0:7464:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1789518057.155084:0:7464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0793100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7464:1876445627428096:0@lo:700: 00000100:00100000:3.0:1789518057.155113:0:7464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518057.155138:0:7464:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffff76fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518057.156150:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627428096 00000100:00100000:0.0:1789518057.156157:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627428096 00000100:00100000:0.0:1789518057.156200:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789518057.156209:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0791180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7464:x1876445627428096:12345-0@lo:700: 00000100:00100000:0.0:1789518057.156459:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6502300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6656:1876445627428224:0@lo:700: 00000100:00100000:0.0:1789518057.156505:0:6656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518057.156539:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc803b600 going to sleep for 11 seconds 00000100:00100000:2.0:1789518057.156766:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627428224 00000100:00100000:2.0:1789518057.156771:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627428224 00000100:00100000:2.0:1789518057.156800:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789518057.156807:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6656:x1876445627428224:12345-0@lo:700: 40000000:02000000:3.0:1789518057.173840:0:5818:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1789518057.179193:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6656:x1876445627428224:12345-0@lo:700: Request processed in 22378us (22682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518057.179211:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789518057.179277:0:6656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffc6502300 x1876445627428224/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789518073 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518057.179292:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6502300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6656:1876445627428224:0@lo:700: 40000000:02000000:0.0:1789518057.179306:0:6656:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:3.0:1789518057.218369:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1789518057.218385:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:0.0:1789518057.218977:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0791180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7464:x1876445627428096:12345-0@lo:700: Request processed in 62765us (63859us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518057.218988:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789518057.219051:0:7464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffd0793100 x1876445627428096/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789518073 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518057.219063:0:7464:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789518057.219078:0:7464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0793100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7464:1876445627428096:0@lo:700: 00000004:02000040:3.0:1789518057.235300:0:7464:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1789518057.239490:0:7464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0793100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7464:1876445627428352:0@lo:5: 00000100:00100000:3.0:1789518057.239548:0:7464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518057.239774:0:7464:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffff76fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518057.239824:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627428352 00000100:00100000:2.0:1789518057.239832:0:6649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627428352 00000100:00100000:2.0:1789518057.239882:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789518057.239892:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0791f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7464:x1876445627428352:12345-0@lo:5: 00002000:00080000:2.0:1789518057.245234:0:6649:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1789518057.245253:0:6649:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1789518057.248546:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0791f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7464:x1876445627428352:12345-0@lo:5: Request processed in 8650us (8991us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789518057.248556:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789518057.248669:0:7464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffd0793100 x1876445627428352/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789518073 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518057.248687:0:7464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0793100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7464:1876445627428352:0@lo:5: 00000004:00080000:0.0:1789518057.248704:0:7464:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1789518057.908475:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789518058.518217:0:7589:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789518058.518227:0:7589:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1789518058.518363:0:7589:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99ffff791800 00000020:01000004:1.0:1789518058.518377:0:7589:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789518058.518597:0:7589:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1789518058.518611:0:7589:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff99ffd10fcd40) 00000020:00000080:1.0:1789518058.518736:0:7589:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789518058.538252:0:7589:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1789518058.538540:0:7589:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789518058.556673:0:7589:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789518058.560934:0:7589:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789518058.560965:0:7589:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789518058.561022:0:7589:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789518058.561050:0:7589:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789518058.561729:0:7589:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789518058.561741:0:7589:0:(osd_handler.c:1614:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789518058.561755:0:7589:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x631fd8698c780b1a 00000020:01000004:2.0:1789518058.561762:0:7589:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789518058.561781:0:7589:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.151@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789518058.561784:0:7589:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789518058.561789:0:7589:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789518058.561808:0:7589:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789518058.561811:0:7589:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.151@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789518058.575264:0:7589:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789518058.575299:0:7589:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.151@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1789518058.575303:0:7589:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789518058.575305:0:7589:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789518058.575306:0:7589:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789518058.575307:0:7589:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789518058.575308:0:7589:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789518058.575309:0:7589:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789518058.575310:0:7589:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789518058.575312:0:7589:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789518058.575313:0:7589:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789518058.575315:0:7589:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789518058.575316:0:7589:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789518058.575319:0:7589:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1789518058.575322:0:7589:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789518058.575323:0:7589:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789518058.575324:0:7589:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789518058.575325:0:7589:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789518058.575326:0:7589:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789518058.575327:0:7589:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789518058.575328:0:7589:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789518058.575330:0:7589:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789518058.575330:0:7589:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789518058.575332:0:7589:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789518058.575333:0:7589:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789518058.575356:0:7589:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789518058.575373:0:7589:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:7589:1876445627428480:0@lo:253: 00000100:00100000:2.0:1789518058.575448:0:7589:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518058.575576:0:7589:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8116f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518058.575724:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627428480 00000100:00100000:0.0:1789518058.575732:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627428480 00000100:00100000:0.0:1789518058.575810:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789518058.575820:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7646450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+16:7589:x1876445627428480:12345-0@lo:253: 20000000:01000000:0.0:1789518058.575847:0:5806:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789518058.575852:0:5806:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1789518058.575857:0:5806:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1789518058.575860:0:5806:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1789518058.576703:0:5806:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789518058.576912:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1789518058.576930:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1789518058.576981:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1789518058.576990:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1789518058.577022:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1789518058.577073:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1789518058.577299:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1789518058.577316:0:5806:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.151@tcp 20000000:01000000:0.0:1789518058.577319:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.151@tcp (null) (null) (null) 00000040:00080000:0.0:1789518058.577354:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1789518058.577362:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789518058.577444:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1789518058.577453:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.151@tcp (null) (null) 00000040:00080000:0.0:1789518058.577487:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1789518058.577496:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789518058.577529:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1789518058.577581:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1789518058.578091:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1789518058.578107:0:5806:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.151@tcp 20000000:01000000:0.0:1789518058.578109:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.151@tcp (null) (null) (null) 00000040:00080000:0.0:1789518058.578143:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1789518058.578150:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789518058.578182:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1789518058.578189:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.151@tcp (null) (null) 00000040:00080000:0.0:1789518058.578221:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1789518058.578230:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789518058.578279:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1789518058.578317:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1789518058.578330:0:5806:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1789518058.578332:0:5806:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1789518058.578336:0:5806:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789518058.578337:0:5806:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789518058.578338:0:5806:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789518058.578346:0:5806:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789518058.578348:0:5806:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789518058.578368:0:5806:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789518058.578370:0:5806:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789518058.578940:0:7591:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1789518058.578980:0:7591:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1789518058.579011:0:7591:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1789518058.579259:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1789518058.579317:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1789518058.579354:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1789518058.579366:0:5806:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789518058.579368:0:5806:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789518058.580678:0:7592:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1789518058.580997:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1789518058.581043:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1789518058.581107:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1789518058.581121:0:5806:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789518058.581123:0:5806:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789518058.581774:0:7593:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1789518058.581896:0:7593:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1789518058.581956:0:7593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1789518058.582161:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1789518058.582196:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1789518058.582249:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1789518058.582262:0:5806:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789518058.582263:0:5806:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789518058.583320:0:7594:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1789518058.583408:0:7594:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1789518058.583441:0:7594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1789518058.583727:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1789518058.583788:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1789518058.583844:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:0.0:1789518058.583865:0:5806:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789518058.583885:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780b21 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.583904:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffc29c8000/0x631fd8698c780a72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780a6b expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.583917:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffc0030800/0x631fd8698c780a9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780a95 expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.583925:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffc0031800/0x631fd8698c780ac6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780abf expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.583932:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffc29c9400/0x631fd8698c780ae2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780adb expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.583939:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffc29c9a00/0x631fd8698c780b0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780b05 expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.583947:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780b21 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.583983:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffc29c9a00/0x631fd8698c780b0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c780b05 expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.583995:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffc29c9a00/0x631fd8698c780b0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c780b05 expref: 16 pid: 5805 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518058.584008:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6502300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5806:1876445627428608:0@lo:104: 00000100:00100000:0.0:1789518058.584070:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789518058.584140:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffc29c9400/0x631fd8698c780ae2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c780adb expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.584149:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffc29c9400/0x631fd8698c780ae2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c780adb expref: 16 pid: 5806 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518058.584157:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6500a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5806:1876445627428736:0@lo:104: 00010000:00010000:0.0:1789518058.584183:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffc0031800/0x631fd8698c780ac6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c780abf expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.584191:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffc0031800/0x631fd8698c780ac6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c780abf expref: 16 pid: 5807 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518058.584198:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6503480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5806:1876445627428864:0@lo:104: 00010000:00010000:0.0:1789518058.584223:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffc0030800/0x631fd8698c780a9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c780a95 expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.584230:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffc0030800/0x631fd8698c780a9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c780a95 expref: 16 pid: 5806 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518058.584237:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6500000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5806:1876445627428992:0@lo:104: 00010000:00010000:0.0:1789518058.584259:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffc29c8000/0x631fd8698c780a72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c780a6b expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.584266:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffc29c8000/0x631fd8698c780a72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c780a6b expref: 16 pid: 5807 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518058.584274:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6503b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5806:1876445627429120:0@lo:104: 00000100:00100000:0.0:1789518058.584291:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc514a300 going to sleep for 11 seconds 00000100:00100000:3.0:1789518058.584355:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789518058.584373:0:5795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518058.584407:0:5795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518058.584417:0:5795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518058.584426:0:5795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518058.584435:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627428608 00000100:00100000:3.0:1789518058.584441:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627428608 00000100:00100000:3.0:1789518058.584471:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627428736 00000100:00100000:3.0:1789518058.584474:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627428736 00000100:00100000:3.0:1789518058.584484:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627428864 00000100:00100000:3.0:1789518058.584486:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627428864 00000100:00100000:3.0:1789518058.584494:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627428992 00000100:00100000:3.0:1789518058.584496:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627428992 00000100:00100000:3.0:1789518058.584515:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627429120 00000100:00100000:3.0:1789518058.584518:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627429120 00000100:00100000:3.0:1789518058.584530:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789518058.584537:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd8119450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:824c8f07-28fa-48fd-81af-173b194570e6+7:5806:x1876445627428608:12345-0@lo:104: 00010000:00010000:3.0:1789518058.584549:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff9a00021c6400/0x631fd8698c780b05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780b0c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518058.584607:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789518058.584635:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd8119450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:824c8f07-28fa-48fd-81af-173b194570e6+7:5806:x1876445627428608:12345-0@lo:104: Request processed in 98us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518058.584643:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1789518058.584649:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518058.584657:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9a00021c6400/0x631fd8698c780b05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780b0c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.584678:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6400 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:2.0:1789518058.584682:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9a00021c6400/0x631fd8698c780b05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c780b0c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518058.584691:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1789518058.584692:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9a00021c6400/0x631fd8698c780b05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c780b0c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518058.584702:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0790700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:824c8f07-28fa-48fd-81af-173b194570e6+6:5806:x1876445627428736:12345-0@lo:104: 10000000:00010000:2.0:1789518058.584704:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9a00021c6400/0x631fd8698c780b05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c780b0c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518058.584713:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789518058.584715:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff9a00021c6a00/0x631fd8698c780adb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780ae2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.584751:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9a00021c6400/0x631fd8698c780b05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780b0c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518058.584756:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1789518058.584759:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789518058.584764:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0790700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:824c8f07-28fa-48fd-81af-173b194570e6+6:5806:x1876445627428736:12345-0@lo:104: Request processed in 65us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518058.584772:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1789518058.584780:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9a00021c6400/0x631fd8698c780b05 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780b0c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518058.584788:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1789518058.584789:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9a00021c6400/0x631fd8698c780b05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780b0c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518058.584798:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0790e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:824c8f07-28fa-48fd-81af-173b194570e6+5:5806:x1876445627428864:12345-0@lo:104: 00010000:00010000:3.0:1789518058.584805:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff9a00021c7200/0x631fd8698c780abf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780ac6 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518058.584832:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789518058.584837:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0790e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:824c8f07-28fa-48fd-81af-173b194570e6+5:5806:x1876445627428864:12345-0@lo:104: Request processed in 42us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518058.584851:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789518058.584862:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789518058.584867:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0791500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:824c8f07-28fa-48fd-81af-173b194570e6+4:5806:x1876445627428992:12345-0@lo:104: 00010000:00010000:3.0:1789518058.584874:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff9a00021c7000/0x631fd8698c780a95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780a9c expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518058.584903:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789518058.584907:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0791500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:824c8f07-28fa-48fd-81af-173b194570e6+4:5806:x1876445627428992:12345-0@lo:104: Request processed in 41us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518058.584913:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789518058.584925:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789518058.584931:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0792d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:824c8f07-28fa-48fd-81af-173b194570e6+3:5806:x1876445627429120:12345-0@lo:104: 00010000:00010000:3.0:1789518058.584937:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff9a00021c6000/0x631fd8698c780a6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780a72 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518058.584960:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789518058.584964:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0792d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:824c8f07-28fa-48fd-81af-173b194570e6+3:5806:x1876445627429120:12345-0@lo:104: Request processed in 35us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518058.584969:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1789518058.584982:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:3.0:1789518058.585023:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:824c8f07-28fa-48fd-81af-173b194570e6:3280:1876445627429248:0@lo:103: 00000100:00100000:3.0:1789518058.585056:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518058.585102:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627429248 00000100:00100000:3.0:1789518058.585106:0:5798:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627429248 00010000:00010000:3.0:1789518058.585122:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffc29c9a00/0x631fd8698c780b0c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780b05 expref: 17 pid: 5805 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518058.585167:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789518058.585173:0:5798:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0792680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:824c8f07-28fa-48fd-81af-173b194570e6+17:3280:x1876445627429248:12345-0@lo:103: 00010000:00010000:3.0:1789518058.585183:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518058.585189:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffc29c9a00/0x631fd8698c780b0c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780b05 expref: 17 pid: 5805 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518058.585203:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffc29c9a00/0x631fd8698c780b0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c780b05 expref: 17 pid: 5805 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.585205:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789518058.585212:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9a00021c7200/0x631fd8698c780abf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780ac6 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518058.585221:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518058.585231:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7200 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:2.0:1789518058.585235:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9a00021c7200/0x631fd8698c780abf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c780ac6 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.585243:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9a00021c7200/0x631fd8698c780abf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c780ac6 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518058.585249:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9a00021c7200/0x631fd8698c780abf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c780ac6 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518058.585254:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789518058.585262:0:5798:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0792680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:824c8f07-28fa-48fd-81af-173b194570e6+17:3280:x1876445627429248:12345-0@lo:103: Request processed in 88us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518058.585270:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1789518058.585279:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9a00021c7200/0x631fd8698c780abf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780ac6 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.585287:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789518058.585295:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9a00021c7200/0x631fd8698c780abf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780ac6 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.585302:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9a00021c7200/0x631fd8698c780abf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780ac6 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518058.585306:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:824c8f07-28fa-48fd-81af-173b194570e6:3280:1876445627429248:0@lo:103: 00010000:00010000:2.0:1789518058.585318:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789518058.585322:0:7595:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518058.585323:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9a00021c7000/0x631fd8698c780a95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780a9c expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518058.585327:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1789518058.585331:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9a00021c6a00/0x631fd8698c780adb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780ae2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.585338:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7000 already unused, calling callback (ffffffffc1b17c20) 00000100:00100000:1.0:1789518058.585338:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:824c8f07-28fa-48fd-81af-173b194570e6:3280:1876445627429376:0@lo:103: 00010000:00010000:3.0:1789518058.585346:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6a00 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:2.0:1789518058.585346:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9a00021c7000/0x631fd8698c780a95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c780a9c expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518058.585353:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9a00021c6a00/0x631fd8698c780adb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c780ae2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518058.585363:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9a00021c6a00/0x631fd8698c780adb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c780ae2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.585370:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9a00021c7000/0x631fd8698c780a95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c780a9c expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518058.585373:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9a00021c6a00/0x631fd8698c780adb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c780ae2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518058.585375:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1789518058.585399:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9a00021c7000/0x631fd8698c780a95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c780a9c expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518058.585406:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789518058.585488:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9a00021c7000/0x631fd8698c780a95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780a9c expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.585495:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:3.0:1789518058.585512:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789518058.585516:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9a00021c7000/0x631fd8698c780a95 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780a9c expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.585528:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9a00021c7000/0x631fd8698c780a95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780a9c expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.585540:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518058.585541:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9a00021c6a00/0x631fd8698c780adb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780ae2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.585542:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518058.585546:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518058.585550:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:824c8f07-28fa-48fd-81af-173b194570e6:3282:1876445627429504:0@lo:103: 00010000:00010000:3.0:1789518058.585552:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518058.585563:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9a00021c6a00/0x631fd8698c780adb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780ae2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518058.585571:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9a00021c6a00/0x631fd8698c780adb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780ae2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518058.585585:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518058.585587:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518058.585590:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627429376 00010000:00010000:3.0:1789518058.585591:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518058.585597:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627429376 00000100:00100000:1.0:1789518058.585597:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789518058.585645:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffc0031800/0x631fd8698c780ac6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780abf expref: 17 pid: 5807 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518058.585656:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518058.585685:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627429504 00000100:00100000:2.0:1789518058.585690:0:5798:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627429504 00010000:00010000:2.0:1789518058.585703:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffc0030800/0x631fd8698c780a9c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780a95 expref: 18 pid: 5806 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518058.585719:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789518058.585724:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0793b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:824c8f07-28fa-48fd-81af-173b194570e6:3282:1876445627429632:0@lo:103: 00000100:00100000:2.0:1789518058.585736:0:5798:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4000a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:824c8f07-28fa-48fd-81af-173b194570e6+18:3280:x1876445627429376:12345-0@lo:103: 00010000:00010000:2.0:1789518058.585746:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518058.585752:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffc0031800/0x631fd8698c780ac6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780abf expref: 18 pid: 5807 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518058.585756:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789518058.585767:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffc0031800/0x631fd8698c780ac6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c780abf expref: 18 pid: 5807 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.585780:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518058.585797:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc29c9a00/0x631fd8698c780b0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c780b05 expref: 18 pid: 5805 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518058.585820:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6502300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5806:1876445627428608:0@lo:104: 00000100:00100000:0.0:1789518058.585834:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6500a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5806:1876445627428736:0@lo:104: 00010000:00010000:0.0:1789518058.585843:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc0031800/0x631fd8698c780ac6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c780abf expref: 17 pid: 5807 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518058.585856:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6503480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5806:1876445627428864:0@lo:104: 00000100:00100000:0.0:1789518058.585866:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6500000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5806:1876445627428992:0@lo:104: 00000100:00100000:1.0:1789518058.585876:0:5797:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789518058.585877:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6503b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5806:1876445627429120:0@lo:104: 00000100:00100000:1.0:1789518058.585888:0:5797:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1789518058.585890:0:5798:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4000a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:824c8f07-28fa-48fd-81af-173b194570e6+16:3280:x1876445627429376:12345-0@lo:103: Request processed in 153us (515us total) trans 0 rc 0/0 00010000:00010000:0.0:1789518058.585907:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780b21 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518058.585956:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789518058.585965:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4003480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:824c8f07-28fa-48fd-81af-173b194570e6+16:3282:x1876445627429504:12345-0@lo:103: 00000100:00100000:2.0:1789518058.585971:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1789518058.585976:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518058.585983:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffc0030800/0x631fd8698c780a9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780a95 expref: 16 pid: 5806 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518058.585989:0:5798:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:3.0:1789518058.585994:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffc0030800/0x631fd8698c780a9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c780a95 expref: 15 pid: 5806 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518058.585995:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627429632 00000100:00100000:2.0:1789518058.586001:0:5798:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627429632 00010000:00010000:3.0:1789518058.586011:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc0030800/0x631fd8698c780a9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c780a95 expref: 16 pid: 5806 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.586016:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffc29c9400/0x631fd8698c780ae2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780adb expref: 16 pid: 5806 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518058.586030:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518058.586032:0:5798:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789518058.586097:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789518058.586107:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4000000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:824c8f07-28fa-48fd-81af-173b194570e6+15:3282:x1876445627429632:12345-0@lo:103: 00000100:00100000:3.0:1789518058.586116:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4003480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:824c8f07-28fa-48fd-81af-173b194570e6+15:3282:x1876445627429504:12345-0@lo:103: Request processed in 151us (519us total) trans 0 rc 0/0 00010000:00010000:1.0:1789518058.586117:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518058.586127:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffc29c9400/0x631fd8698c780ae2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780adb expref: 15 pid: 5806 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518058.586130:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789518058.586130:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:824c8f07-28fa-48fd-81af-173b194570e6:3280:1876445627429376:0@lo:103: 00010000:00010000:1.0:1789518058.586147:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffc29c9400/0x631fd8698c780ae2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c780adb expref: 15 pid: 5806 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518058.586159:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc29c9400/0x631fd8698c780ae2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c780adb expref: 14 pid: 5806 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518058.586171:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518058.586198:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4000000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:824c8f07-28fa-48fd-81af-173b194570e6+13:3282:x1876445627429632:12345-0@lo:103: Request processed in 94us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518058.586205:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789518058.586208:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:824c8f07-28fa-48fd-81af-173b194570e6:3282:1876445627429504:0@lo:103: 00000100:00100000:0.0:1789518058.586227:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0793b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:824c8f07-28fa-48fd-81af-173b194570e6:3282:1876445627429632:0@lo:103: 00010000:00010000:1.0:1789518058.586303:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518058.586306:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518058.586308:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518058.586487:0:7595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9a00021c6000/0x631fd8698c780a6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780a72 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.586494:0:7595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6000 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:2.0:1789518058.586498:0:7595:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9a00021c6000/0x631fd8698c780a6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c780a72 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.586504:0:7595:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9a00021c6000/0x631fd8698c780a6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c780a72 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518058.586520:0:7595:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9a00021c6000/0x631fd8698c780a6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c780a72 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518058.586525:0:7595:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789518058.586548:0:7595:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff9a00021c6000/0x631fd8698c780a6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780a72 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.586554:0:7595:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789518058.586577:0:7595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9a00021c6000/0x631fd8698c780a6b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780a72 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.586584:0:7595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9a00021c6000/0x631fd8698c780a6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780a72 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.586598:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518058.586599:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518058.586601:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518058.586665:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:824c8f07-28fa-48fd-81af-173b194570e6:3280:1876445627429760:0@lo:103: 00000100:00100000:3.0:1789518058.586701:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518058.586896:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627429760 00000100:00100000:2.0:1789518058.586901:0:5798:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627429760 00010000:00010000:2.0:1789518058.586984:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffc29c8000/0x631fd8698c780a72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780a6b expref: 13 pid: 5807 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518058.587054:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789518058.587061:0:5798:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0790000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:824c8f07-28fa-48fd-81af-173b194570e6+13:3280:x1876445627429760:12345-0@lo:103: 00010000:00010000:2.0:1789518058.587069:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518058.587074:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffc29c8000/0x631fd8698c780a72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780a6b expref: 13 pid: 5807 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.587083:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffc29c8000/0x631fd8698c780a72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c780a6b expref: 13 pid: 5807 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.587099:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc29c8000/0x631fd8698c780a72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c780a6b expref: 13 pid: 5807 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.587110:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780b21 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.587118:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780b21 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.587129:0:5798:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780b21 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.587136:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780b21 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.587142:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780b21 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.587148:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780b21 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.587153:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc0030a00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518058.587156:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780b21 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.587163:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780b21 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.587182:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780b21 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.587200:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518058.587240:0:5798:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0790000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:824c8f07-28fa-48fd-81af-173b194570e6+12:3280:x1876445627429760:12345-0@lo:103: Request processed in 180us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518058.587247:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1789518058.587294:0:5806:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780b21 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.587301:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780b21 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.587305:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780b21 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518058.587315:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:824c8f07-28fa-48fd-81af-173b194570e6:3280:1876445627429760:0@lo:103: 20000000:01000000:0.0:1789518058.587317:0:5806:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789518058.618436:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7646450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+11:7589:x1876445627428480:12345-0@lo:253: Request processed in 42607us (42977us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518058.618451:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789518058.618494:0:7589:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:7589:1876445627428480:0@lo:253: 10000000:01000000:2.0:1789518058.618527:0:7589:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789518058.618531:0:7589:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789518058.618532:0:7589:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789518058.618534:0:7589:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789518058.618535:0:7589:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1789518058.618536:0:7589:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789518058.618538:0:7589:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789518058.618539:0:7589:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789518058.618541:0:7589:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789518058.618542:0:7589:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789518058.618544:0:7589:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789518058.618562:0:7589:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99ffff791800 from lustre-OST0001 10000000:01000000:2.0:1789518058.618584:0:7589:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789518058.618587:0:7589:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789518058.618593:0:7589:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99ffc64a4d40 local copy 10000000:01000000:2.0:1789518058.618597:0:7589:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789518058.618661:0:7589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8000/0x631fd8698c780b28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.618673:0:7589:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8000/0x631fd8698c780b28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.618683:0:7589:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8000/0x631fd8698c780b28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518058.618701:0:7589:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:7589:1876445627429888:0@lo:101: 00000100:00100000:2.0:1789518058.618742:0:7589:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518058.618846:0:7589:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8116cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518058.621254:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627429888 00000100:00100000:0.0:1789518058.621267:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627429888 00000100:00100000:0.0:1789518058.621338:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789518058.621358:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7645450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+11:7589:x1876445627429888:12345-0@lo:101: 00010000:00010000:0.0:1789518058.621373:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518058.621400:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780b2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780b28 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.621429:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780b2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780b28 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.621440:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780b2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780b28 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.621448:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc0030a00, rc 0) 00000100:00100000:0.0:1789518058.621519:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7645450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+12:7589:x1876445627429888:12345-0@lo:101: Request processed in 163us (2776us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518058.621525:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789518058.621661:0:7589:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:7589:1876445627429888:0@lo:101: 00010000:00010000:1.0:1789518058.621680:0:7589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8000/0x631fd8698c780b28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x631fd8698c780b2f expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518058.621691:0:7589:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8000/0x631fd8698c780b28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x631fd8698c780b2f expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518058.621807:0:7589:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4001880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:7589:1876445627430016:0@lo:501: 00000100:00100000:1.0:1789518058.621841:0:7589:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518058.621879:0:7589:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6aed900 going to sleep for 11 seconds 00000100:00100000:3.0:1789518058.621895:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627430016 00000100:00100000:3.0:1789518058.621899:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627430016 00000100:00100000:3.0:1789518058.621930:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789518058.621993:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7644c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+12:7589:x1876445627430016:12345-0@lo:501: 00000100:00100000:3.0:1789518058.622154:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7644c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+12:7589:x1876445627430016:12345-0@lo:501: Request processed in 217us (312us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789518058.622161:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789518058.622217:0:7589:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4001880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:7589:1876445627430016:0@lo:501: 10000000:01000000:1.0:1789518058.622226:0:7589:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789518058.622243:0:7589:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789518058.622247:0:7589:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8000/0x631fd8698c780b28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x631fd8698c780b2f expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518058.622253:0:7589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8000/0x631fd8698c780b28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x631fd8698c780b2f expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518058.622257:0:7589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8000/0x631fd8698c780b28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x631fd8698c780b2f expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518058.622275:0:7589:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789518058.622289:0:7589:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99ffff791800 10000000:01000000:1.0:1789518058.622294:0:7589:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789518058.622298:0:7589:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789518058.622301:0:7589:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789518058.622304:0:7589:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789518058.622307:0:7589:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789518058.622322:0:7589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1400/0x631fd8698c780b36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518058.622329:0:7589:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1400/0x631fd8698c780b36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518058.622337:0:7589:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1400/0x631fd8698c780b36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518058.622348:0:7589:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4001880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:7589:1876445627430144:0@lo:101: 00010000:00010000:2.0:1789518058.622380:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789518058.622395:0:7589:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789518058.622400:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8000/0x631fd8698c780b28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x631fd8698c780b2f expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.622409:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29c8000 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:2.0:1789518058.622413:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8000/0x631fd8698c780b28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x631fd8698c780b2f expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518058.622420:0:7589:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6aedd80 going to sleep for 11 seconds 00010000:00010000:2.0:1789518058.622421:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8000/0x631fd8698c780b28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x631fd8698c780b2f expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518058.622431:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8000/0x631fd8698c780b28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x631fd8698c780b2f expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518058.622437:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789518058.622455:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8000/0x631fd8698c780b28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x631fd8698c780b2f expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.622460:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789518058.622478:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627430144 00000100:00100000:3.0:1789518058.622483:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627430144 00010000:00010000:2.0:1789518058.622487:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8000/0x631fd8698c780b28 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x631fd8698c780b2f expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.622495:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8000/0x631fd8698c780b28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x631fd8698c780b2f expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.622508:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518058.622511:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518058.622514:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00010000:00010000:2.0:1789518058.622515:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518058.622526:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7644050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+12:7589:x1876445627430144:12345-0@lo:101: 00010000:00010000:3.0:1789518058.622534:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518058.622543:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc6b17a00/0x631fd8698c780b3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780b36 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518058.622559:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc6b17a00/0x631fd8698c780b3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780b36 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518058.622567:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:824c8f07-28fa-48fd-81af-173b194570e6:3281:1876445627430272:0@lo:103: 00010000:00010000:3.0:1789518058.622571:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc6b17a00/0x631fd8698c780b3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780b36 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518058.622580:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17a00, rc 0) 00000100:00100000:0.0:1789518058.622608:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518058.622643:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7644050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+13:7589:x1876445627430144:12345-0@lo:101: Request processed in 119us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518058.622645:0:7589:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4001880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:7589:1876445627430144:0@lo:101: 00010000:00010000:1.0:1789518058.622656:0:7589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1400/0x631fd8698c780b36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780b3d expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518058.622659:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:1.0:1789518058.622664:0:7589:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1400/0x631fd8698c780b36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780b3d expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518058.622716:0:7589:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4001880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:7589:1876445627430400:0@lo:501: 00000100:00100000:1.0:1789518058.622738:0:7589:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518058.622748:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627430272 00000100:00100000:2.0:1789518058.622759:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627430272 00000100:00100000:1.0:1789518058.622762:0:7589:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6aedd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789518058.622799:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789518058.622806:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6503b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:824c8f07-28fa-48fd-81af-173b194570e6+13:3281:x1876445627430272:12345-0@lo:103: 00010000:00010000:2.0:1789518058.622815:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518058.622825:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780b2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c780b28 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.622835:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518058.622868:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6503b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:824c8f07-28fa-48fd-81af-173b194570e6+12:3281:x1876445627430272:12345-0@lo:103: Request processed in 63us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518058.622875:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789518058.622890:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:824c8f07-28fa-48fd-81af-173b194570e6:3281:1876445627430272:0@lo:103: 00000100:00100000:0.0:1789518058.622940:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627430400 00000100:00100000:0.0:1789518058.622945:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627430400 00000100:00100000:0.0:1789518058.622975:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789518058.622981:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7644450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+12:7589:x1876445627430400:12345-0@lo:501: 00000100:00100000:0.0:1789518058.623149:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7644450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+12:7589:x1876445627430400:12345-0@lo:501: Request processed in 167us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518058.623157:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789518058.623552:0:7589:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4001880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:7589:1876445627430400:0@lo:501: 00000100:00100000:1.0:1789518058.623578:0:7589:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4001880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:7589:1876445627430528:0@lo:503: 00000100:00100000:1.0:1789518058.623639:0:7589:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518058.623667:0:7589:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6aedd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789518058.623723:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627430528 00000100:00100000:3.0:1789518058.623728:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627430528 00000100:00100000:3.0:1789518058.623758:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789518058.623766:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7647850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+12:7589:x1876445627430528:12345-0@lo:503: 00000100:00100000:3.0:1789518058.623898:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7647850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+12:7589:x1876445627430528:12345-0@lo:503: Request processed in 132us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518058.623905:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789518058.623996:0:7589:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4001880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:7589:1876445627430528:0@lo:503: 00000040:00080000:1.0:1789518058.624274:0:7589:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789518058.624323:0:7589:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4001880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:7589:1876445627430656:0@lo:502: 00000100:00100000:1.0:1789518058.624353:0:7589:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518058.624376:0:7589:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6aedd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789518058.624420:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627430656 00000100:00100000:0.0:1789518058.624425:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627430656 00000100:00100000:0.0:1789518058.624461:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789518058.624469:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7645850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+12:7589:x1876445627430656:12345-0@lo:502: 00000100:00100000:0.0:1789518058.624642:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7645850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+12:7589:x1876445627430656:12345-0@lo:502: Request processed in 143us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518058.624650:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789518058.624725:0:7589:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4001880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:7589:1876445627430656:0@lo:502: 00000040:00080000:1.0:1789518058.625338:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789518058.625409:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789518058.625684:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789518058.625740:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789518058.625782:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789518058.625812:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789518058.625838:0:7589:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4001880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:7589:1876445627430784:0@lo:502: 00000100:00100000:1.0:1789518058.625879:0:7589:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518058.625903:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627430784 00000100:00100000:1.0:1789518058.625907:0:7589:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6aedd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789518058.625911:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627430784 00000100:00100000:2.0:1789518058.625943:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789518058.625951:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7645050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+12:7589:x1876445627430784:12345-0@lo:502: 00000100:00100000:2.0:1789518058.626117:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7645050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+12:7589:x1876445627430784:12345-0@lo:502: Request processed in 166us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518058.626124:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789518058.626161:0:7589:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4001880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:7589:1876445627430784:0@lo:502: 00000040:00080000:1.0:1789518058.626231:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789518058.626240:0:7589:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1789518058.626691:0:7598:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789518058.626698:0:7598:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1789518058.626704:0:7598:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518058.626707:0:7598:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789518058.626712:0:7598:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789518058.626733:0:7598:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff99fff78399c0) 00000020:00000080:1.0:1789518058.626754:0:7598:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789518058.626760:0:7598:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789518058.626824:0:7598:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ffff791800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789518058.626831:0:7598:0:(osd_handler.c:1614:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789518058.626837:0:7598:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x631fd8698c780b4b 00010000:00010000:1.0:1789518058.630352:0:7598:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1789518058.630708:0:7598:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1789518058.634379:0:7598:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789518058.634797:0:7598:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1789518058.639019:0:7598:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1789518058.639794:0:7598:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1789518058.642843:0:7598:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789518058.642855:0:7598:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789518058.642860:0:7598:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518058.642862:0:7598:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789518058.642868:0:7598:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789518058.642871:0:7598:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518058.642873:0:7598:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789518058.642876:0:7598:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789518058.642877:0:7598:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789518058.642925:0:7598:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789518058.642928:0:7598:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518058.642929:0:7598:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789518058.642951:0:7598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789518058.643042:0:7589:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1789518058.643067:0:7589:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789518058.643087:0:7589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1400/0x631fd8698c780b36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780b3d expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518058.643108:0:7589:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1400/0x631fd8698c780b36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780b3d expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518058.643116:0:7589:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ffff791800 from 1 10000000:01000000:1.0:1789518058.643119:0:7589:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789518058.643150:0:7589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0600/0x631fd8698c780b52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518058.643158:0:7589:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0600/0x631fd8698c780b52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518058.643170:0:7589:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0600/0x631fd8698c780b52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518058.643205:0:7589:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4001880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:7589:1876445627430912:0@lo:101: 00000100:00100000:1.0:1789518058.643267:0:7589:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518058.643297:0:7589:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc9113300 going to sleep for 11 seconds 00000100:00100000:0.0:1789518058.645032:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627430912 00000100:00100000:0.0:1789518058.645042:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627430912 00000100:00100000:0.0:1789518058.645092:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789518058.645103:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7646850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+12:7589:x1876445627430912:12345-0@lo:101: 00010000:00010000:0.0:1789518058.645117:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518058.645131:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc0031800/0x631fd8698c780b59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780b52 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.645153:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc0031800/0x631fd8698c780b59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780b52 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.645164:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc0031800/0x631fd8698c780b59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780b52 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.645173:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc0031800, rc 0) 00000100:00100000:0.0:1789518058.645237:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7646850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+13:7589:x1876445627430912:12345-0@lo:101: Request processed in 136us (1969us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518058.645244:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789518058.645282:0:7589:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4001880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:7589:1876445627430912:0@lo:101: 00010000:00010000:3.0:1789518058.645301:0:7589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0600/0x631fd8698c780b52 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780b59 expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518058.645310:0:7589:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0600/0x631fd8698c780b52 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780b59 expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518058.645421:0:7589:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0790a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:7589:1876445627431040:0@lo:501: 00000100:00100000:3.0:1789518058.645453:0:7589:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518058.645489:0:7589:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc67cbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518058.645528:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627431040 00000100:00100000:0.0:1789518058.645533:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627431040 00000100:00100000:0.0:1789518058.645565:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789518058.645572:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7646c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+13:7589:x1876445627431040:12345-0@lo:501: 00000100:00100000:0.0:1789518058.645842:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7646c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+13:7589:x1876445627431040:12345-0@lo:501: Request processed in 269us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518058.645849:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789518058.645917:0:7589:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0790a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:7589:1876445627431040:0@lo:501: 00000100:00100000:3.0:1789518058.645955:0:7589:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0790a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:7589:1876445627431168:0@lo:503: 00000100:00100000:3.0:1789518058.645992:0:7589:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518058.646018:0:7589:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc67cbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518058.646213:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627431168 00000100:00100000:0.0:1789518058.646218:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627431168 00000100:00100000:0.0:1789518058.646394:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789518058.646403:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7647450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+13:7589:x1876445627431168:12345-0@lo:503: 00000100:00100000:0.0:1789518058.646810:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7647450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+13:7589:x1876445627431168:12345-0@lo:503: Request processed in 407us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518058.646818:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789518058.646841:0:7589:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0790a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:7589:1876445627431168:0@lo:503: 00000040:00080000:3.0:1789518058.647157:0:7589:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789518058.647217:0:7589:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0790a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:7589:1876445627431296:0@lo:502: 00000100:00100000:3.0:1789518058.647258:0:7589:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518058.647289:0:7589:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc67cbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518058.647318:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627431296 00000100:00100000:0.0:1789518058.647323:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627431296 00000100:00100000:0.0:1789518058.647401:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789518058.647410:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7647050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+13:7589:x1876445627431296:12345-0@lo:502: 00000100:00100000:0.0:1789518058.647575:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7647050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+13:7589:x1876445627431296:12345-0@lo:502: Request processed in 166us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518058.647594:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789518058.647663:0:7589:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0790a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:7589:1876445627431296:0@lo:502: 00000040:00080000:3.0:1789518058.647897:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789518058.647961:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789518058.647983:0:7589:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0790a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:7589:1876445627431424:0@lo:502: 00000100:00100000:3.0:1789518058.648019:0:7589:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518058.648048:0:7589:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc67cbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518058.648325:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627431424 00000100:00100000:0.0:1789518058.648330:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627431424 00000100:00100000:0.0:1789518058.648361:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789518058.648369:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7647c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+13:7589:x1876445627431424:12345-0@lo:502: 00000100:00100000:0.0:1789518058.648514:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7647c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+13:7589:x1876445627431424:12345-0@lo:502: Request processed in 146us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518058.648519:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789518058.648573:0:7589:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0790a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:7589:1876445627431424:0@lo:502: 00000040:00080000:1.0:1789518058.648729:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789518058.648742:0:7589:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789518058.649364:0:7602:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789518058.649372:0:7602:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518058.649374:0:7602:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789518058.649381:0:7602:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ffff791800 00000020:00000080:1.0:1789518058.649396:0:7602:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789518058.649415:0:7602:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518058.649418:0:7602:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518058.649419:0:7602:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789518058.649421:0:7602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789518058.649497:0:7589:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789518058.649523:0:7589:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789518058.649543:0:7589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0600/0x631fd8698c780b52 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780b59 expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.649555:0:7589:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0600/0x631fd8698c780b52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780b59 expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518058.649598:0:7589:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789518058.649601:0:7589:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99ffff791800 10000000:01000000:2.0:1789518058.649604:0:7589:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99ffff791800 10000000:01000000:2.0:1789518058.649608:0:7589:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789518058.649654:0:7589:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99ffff791800 from 1 10000000:01000000:2.0:1789518058.649657:0:7589:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789518058.649684:0:7589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8000/0x631fd8698c780b60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.649692:0:7589:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8000/0x631fd8698c780b60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.649702:0:7589:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8000/0x631fd8698c780b60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518058.649718:0:7589:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:7589:1876445627431552:0@lo:101: 00000100:00100000:2.0:1789518058.649757:0:7589:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518058.649792:0:7589:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8116a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789518058.649817:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627431552 00000100:00100000:0.0:1789518058.649822:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627431552 00000100:00100000:0.0:1789518058.649897:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789518058.649906:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+13:7589:x1876445627431552:12345-0@lo:101: 00010000:00010000:0.0:1789518058.649916:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518058.649927:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc0030200/0x631fd8698c780b67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780b60 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.649970:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc0030200/0x631fd8698c780b67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780b60 expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.649980:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc0030200/0x631fd8698c780b67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780b60 expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.649988:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc0030200, rc 0) 00000100:00100000:0.0:1789518058.650020:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+14:7589:x1876445627431552:12345-0@lo:101: Request processed in 116us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518058.650026:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789518058.650176:0:7589:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:7589:1876445627431552:0@lo:101: 00010000:00010000:2.0:1789518058.650200:0:7589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8000/0x631fd8698c780b60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780b67 expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.650219:0:7589:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8000/0x631fd8698c780b60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780b67 expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518058.650287:0:7589:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:7589:1876445627431680:0@lo:501: 00000100:00100000:2.0:1789518058.650309:0:7589:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518058.653434:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627431680 00000100:00100000:1.0:1789518058.653447:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627431680 00000100:00100000:1.0:1789518058.653497:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789518058.653506:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+14:7589:x1876445627431680:12345-0@lo:501: 00000100:00100000:1.0:1789518058.654219:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+14:7589:x1876445627431680:12345-0@lo:501: Request processed in 712us (3906us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518058.654239:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789518058.654677:0:7589:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8116a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789518058.654698:0:7589:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:7589:1876445627431680:0@lo:501: 00000100:00100000:2.0:1789518058.654740:0:7589:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:7589:1876445627431808:0@lo:503: 00000100:00100000:2.0:1789518058.654782:0:7589:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518058.654815:0:7589:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8116a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789518058.654829:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627431808 00000100:00100000:1.0:1789518058.654835:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627431808 00000100:00100000:1.0:1789518058.654873:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789518058.654882:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+14:7589:x1876445627431808:12345-0@lo:503: 00000100:00100000:1.0:1789518058.655048:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+14:7589:x1876445627431808:12345-0@lo:503: Request processed in 167us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518058.655055:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789518058.655208:0:7589:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:7589:1876445627431808:0@lo:503: 00000040:00080000:3.0:1789518058.655479:0:7589:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789518058.655552:0:7589:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0790380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:7589:1876445627431936:0@lo:502: 00000100:00100000:3.0:1789518058.655587:0:7589:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518058.655607:0:7589:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc67cbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518058.655638:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627431936 00000100:00100000:0.0:1789518058.655644:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627431936 00000100:00100000:0.0:1789518058.655673:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789518058.655681:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+14:7589:x1876445627431936:12345-0@lo:502: 00000100:00100000:0.0:1789518058.655863:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+14:7589:x1876445627431936:12345-0@lo:502: Request processed in 182us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518058.655871:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789518058.656284:0:7589:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0790380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:7589:1876445627431936:0@lo:502: 00000040:00080000:3.0:1789518058.656886:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789518058.656935:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789518058.656977:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789518058.657018:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789518058.657047:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789518058.657097:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789518058.657130:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789518058.657163:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789518058.657222:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789518058.657252:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789518058.657292:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789518058.657343:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789518058.657405:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789518058.657440:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789518058.657509:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789518058.657545:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789518058.657582:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789518058.657655:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789518058.657699:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789518058.657732:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789518058.657777:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789518058.657809:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789518058.657835:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789518058.657875:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789518058.657907:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1789518058.657940:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1789518058.657981:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1789518058.658013:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1789518058.658058:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1789518058.658105:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1789518058.658143:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1789518058.658178:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1789518058.658209:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1789518058.658273:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1789518058.658311:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1789518058.658360:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1789518058.658412:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1789518058.658451:0:7589:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0790380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:7589:1876445627432064:0@lo:502: 00000100:00100000:3.0:1789518058.658514:0:7589:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518058.658561:0:7589:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc67cbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789518058.658693:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627432064 00000100:00100000:2.0:1789518058.658701:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627432064 00000100:00100000:2.0:1789518058.658755:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789518058.658764:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+14:7589:x1876445627432064:12345-0@lo:502: 00000100:00100000:2.0:1789518058.658996:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+14:7589:x1876445627432064:12345-0@lo:502: Request processed in 232us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518058.659004:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789518058.659579:0:7589:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0790380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:7589:1876445627432064:0@lo:502: 00000040:00080000:3.0:1789518058.659935:0:7589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1789518058.659948:0:7589:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1789518058.661211:0:7603:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789518058.661843:0:7603:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff99fff7838000) 00000020:00000080:1.0:1789518058.661867:0:7603:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1789518058.662173:0:7603:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ffff791800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789518058.662178:0:7603:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ffff791800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789518058.662180:0:7603:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffff791800 3 00010000:00080000:1.0:1789518058.662207:0:7603:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99fff7b5c800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.151@tcp at head 00010000:00010000:1.0:1789518058.665822:0:7603:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1789518058.666034:0:7603:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789518058.666071:0:7603:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789518058.666083:0:7603:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x631fd8698c780b75 00000100:00080000:1.0:1789518058.666092:0:7603:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789518058.666104:0:7603:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99fff7b5c800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1789518058.666137:0:7603:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fff4002a00 x1876445627432192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789518058.666168:0:7603:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789518058.666272:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4002a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3279:1876445627432192:0@lo:38: 00000100:00100000:0.0:1789518058.666333:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518058.666418:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627432192 00000100:00100000:2.0:1789518058.666426:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627432192 00000100:00100000:2.0:1789518058.666465:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789518058.666474:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3279:x1876445627432192:12345-0@lo:38: 00010000:00080000:2.0:1789518058.666496:0:5813:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 112 last 0 00000020:00000080:2.0:1789518058.666531:0:5813:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x631fd8698c780b7c 00000004:00100000:2.0:1789518058.666543:0:5813:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789518058.666573:0:5813:0:(import.c:65:import_set_state_nolock()) ffff99fffdc8a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789518058.666660:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876445627432192:12345-0@lo:38: Request processed in 186us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518058.666668:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789518058.666689:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99fff4002a00 x1876445627432192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789518068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518058.666696:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627432448:0@lo:400: 00000100:00100000:2.0:1789518058.666726:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518058.666747:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789518058.666753:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627432320:0@lo:400: 00000100:00100000:0.0:1789518058.666770:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789518058.666780:0:3279:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00100000:2.0:1789518058.666785:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789518058.666790:0:3279:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789518058.666796:0:3279:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789518058.666799:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99fff7b5c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789518058.666812:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789518058.666814:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4002a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3279:1876445627432192:0@lo:38: 00000100:00100000:2.0:1789518058.666824:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627432576:0@lo:400: 00000100:00100000:2.0:1789518058.666857:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518058.666890:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627432448 00000100:00100000:2.0:1789518058.666894:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627432448 00000100:00100000:2.0:1789518058.666925:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627432320 00000100:00100000:2.0:1789518058.666928:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627432320 00000100:00100000:2.0:1789518058.666947:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789518058.666954:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627432448:12345-0@lo:400: 00000100:00100000:2.0:1789518058.666996:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627432448:12345-0@lo:400: Request processed in 44us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518058.667003:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789518058.667017:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789518058.667024:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627432320:12345-0@lo:400: 00000100:00100000:2.0:1789518058.667056:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627432320:12345-0@lo:400: Request processed in 33us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518058.667061:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789518058.667090:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffd846ce00 x1876445627432320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518058.667113:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627432320:0@lo:400: 00010000:00080000:2.0:1789518058.667127:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffd846c700 x1876445627432448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518058.667135:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627432448:0@lo:400: 00000100:00100000:0.0:1789518058.667277:0:6647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627432576 00000100:00100000:0.0:1789518058.667282:0:6647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627432576 00000100:00100000:0.0:1789518058.667324:0:6647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789518058.667333:0:6647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627432576:12345-0@lo:400: 00000100:00100000:0.0:1789518058.667374:0:6647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627432576:12345-0@lo:400: Request processed in 42us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518058.667380:0:6647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789518058.667567:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffd846d180 x1876445627432576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518058.667578:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627432576:0@lo:400: 00000100:00100000:0.0:1789518058.667593:0:7604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6503480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7604:1876445627432704:0@lo:901: 00000100:00100000:0.0:1789518058.667647:0:7604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518058.667670:0:7604:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc514a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518058.667690:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627432704 00000100:00100000:2.0:1789518058.667696:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627432704 00000040:00080000:1.0:1789518058.667725:0:7603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:2.0:1789518058.667743:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789518058.667751:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7604:x1876445627432704:12345-0@lo:901: 00000100:00080000:0.0:1789518058.667813:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:3.0:1789518058.668006:0:7589:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 00000100:00100000:2.0:1789518058.668006:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7604:x1876445627432704:12345-0@lo:901: Request processed in 255us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518058.668017:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 10000000:01000000:3.0:1789518058.668040:0:7589:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789518058.668070:0:7589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8000/0x631fd8698c780b60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780b67 expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518058.668080:0:7589:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8000/0x631fd8698c780b60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780b67 expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789518058.668130:0:7589:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789518058.668132:0:7589:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789518058.668134:0:7589:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789518058.668135:0:7589:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789518058.668136:0:7589:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789518058.668138:0:7589:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789518058.668139:0:7589:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789518058.668140:0:7589:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789518058.668142:0:7589:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789518058.668144:0:7589:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789518058.668145:0:7589:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789518058.668148:0:7589:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1789518058.668151:0:7589:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789518058.668152:0:7589:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789518058.668154:0:7589:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789518058.668155:0:7589:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789518058.668156:0:7589:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789518058.668157:0:7589:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789518058.668158:0:7589:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789518058.668160:0:7589:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789518058.668161:0:7589:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789518058.668162:0:7589:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789518058.668163:0:7589:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789518058.668178:0:7589:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789518058.668187:0:7589:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0790380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:7589:1876445627432832:0@lo:253: 00000100:00100000:3.0:1789518058.668224:0:7589:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518058.668256:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627432832 00000100:00100000:3.0:1789518058.668261:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627432832 00010000:00080000:0.0:1789518058.668266:0:7604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffc6503480 x1876445627432704/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789518074 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518058.668279:0:7604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6503480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7604:1876445627432704:0@lo:901: 00000100:00100000:3.0:1789518058.668296:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789518058.668305:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+14:7589:x1876445627432832:12345-0@lo:253: 20000000:01000000:3.0:1789518058.668331:0:5807:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789518058.668344:0:5807:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1789518058.669476:0:7589:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc67cbf00 going to sleep for 11 seconds 20000000:01000000:1.0:1789518058.690557:0:5807:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789518058.690583:0:5807:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789518058.690599:0:5827:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789518058.690605:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789518058.690662:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ffc29c9400/0x631fd8698c780b83 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.690679:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffc29c8400/0x631fd8698c780ad4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780acd expref: 14 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.690687:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ffc29c9400/0x631fd8698c780b83 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.690723:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffc29c8400/0x631fd8698c780ad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c780acd expref: 14 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.690747:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffc29c8400/0x631fd8698c780ad4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c780acd expref: 14 pid: 5806 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518058.690761:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5827:1876445627432960:0@lo:104: 00000100:00100000:2.0:1789518058.690815:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518058.690871:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8116e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789518058.691017:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627432960 00000100:00100000:0.0:1789518058.691025:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627432960 00000100:00100000:0.0:1789518058.691107:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789518058.691117:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:824c8f07-28fa-48fd-81af-173b194570e6+3:5827:x1876445627432960:12345-0@lo:104: 00010000:00010000:0.0:1789518058.691128:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8600/0x631fd8698c780acd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780ad4 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.691186:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789518058.691191:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:824c8f07-28fa-48fd-81af-173b194570e6+3:5827:x1876445627432960:12345-0@lo:104: Request processed in 77us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518058.691198:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789518058.691265:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5827:1876445627432960:0@lo:104: 00010000:00010000:2.0:1789518058.691285:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ffc29c9400/0x631fd8698c780b83 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.691710:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518058.691723:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8600/0x631fd8698c780acd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780ad4 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.691730:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29c8600 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:0.0:1789518058.691734:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8600/0x631fd8698c780acd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c780ad4 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.691742:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8600/0x631fd8698c780acd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c780ad4 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518058.691749:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8600/0x631fd8698c780acd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c780ad4 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518058.691754:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789518058.691828:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8600/0x631fd8698c780acd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780ad4 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.691835:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518058.691865:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8600/0x631fd8698c780acd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780ad4 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.691872:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8600/0x631fd8698c780acd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780ad4 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.691887:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518058.691890:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518058.691891:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518058.691930:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6503480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:824c8f07-28fa-48fd-81af-173b194570e6:3281:1876445627433088:0@lo:103: 00000100:00100000:2.0:1789518058.691965:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518058.692039:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627433088 00000100:00100000:0.0:1789518058.692044:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627433088 00010000:00010000:0.0:1789518058.692062:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffc29c8400/0x631fd8698c780ad4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780acd expref: 15 pid: 5806 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518058.692103:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789518058.692111:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd8066050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:824c8f07-28fa-48fd-81af-173b194570e6+15:3281:x1876445627433088:12345-0@lo:103: 00010000:00010000:0.0:1789518058.692121:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518058.692126:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffc29c8400/0x631fd8698c780ad4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780acd expref: 15 pid: 5806 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.692135:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffc29c8400/0x631fd8698c780ad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c780acd expref: 15 pid: 5806 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.692148:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc29c8400/0x631fd8698c780ad4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c780acd expref: 15 pid: 5806 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.692160:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ffc29c9400/0x631fd8698c780b83 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.692168:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc29c9400/0x631fd8698c780b83 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789518058.692181:0:5799:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001576846s 00010000:00010000:0.0:1789518058.692185:0:5799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffc29c9400/0x631fd8698c780b83 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.692191:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffc29c9400/0x631fd8698c780b83 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.692197:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ffc29c9400/0x631fd8698c780b83 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.692204:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ffc29c9400/0x631fd8698c780b83 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.692215:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29c9400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518058.692219:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ffc29c9400/0x631fd8698c780b83 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.692226:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ffc29c9400/0x631fd8698c780b83 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.692237:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ffc29c9400/0x631fd8698c780b83 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518058.692246:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518058.692274:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd8066050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:824c8f07-28fa-48fd-81af-173b194570e6+14:3281:x1876445627433088:12345-0@lo:103: Request processed in 164us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518058.692280:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789518058.692366:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6503480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:824c8f07-28fa-48fd-81af-173b194570e6:3281:1876445627433088:0@lo:103: 00010000:00010000:2.0:1789518058.692399:0:5827:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ffc29c9400/0x631fd8698c780b83 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.692407:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ffc29c9400/0x631fd8698c780b83 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518058.692413:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc29c9400/0x631fd8698c780b83 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518058.699125:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+13:7589:x1876445627432832:12345-0@lo:253: Request processed in 30813us (30891us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518058.699138:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789518058.699281:0:7589:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0790380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:824c8f07-28fa-48fd-81af-173b194570e6:7589:1876445627432832:0@lo:253: 10000000:01000000:3.0:1789518058.699295:0:7589:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789518058.699298:0:7589:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789518058.699300:0:7589:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789518058.699301:0:7589:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789518058.699303:0:7589:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789518058.699304:0:7589:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789518058.699305:0:7589:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789518058.699307:0:7589:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789518058.699308:0:7589:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789518058.699309:0:7589:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789518058.699311:0:7589:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789518058.699312:0:7589:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789518058.699325:0:7589:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789518058.704827:0:7589:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789518058.705087:0:7589:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789518058.705326:0:7589:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789518058.705497:0:7589:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789518058.705770:0:7589:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789518058.706079:0:7589:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789518058.706881:0:7589:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1789518058.816969:0:7589:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789518058.816975:0:7589:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789518058.817027:0:7589:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789518058.817085:0:7589:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.151@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789518058.817097:0:7589:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789518058.817121:0:7589:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1789518058.931822:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518059.954707:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518060.978976:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789518061.831759:0:7945:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789518062.002843:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518062.196943:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627433216:0@lo:13: 00000100:00100000:3.0:1789518062.197154:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518062.197320:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627433216 00000100:00100000:3.0:1789518062.197328:0:6652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627433216 00000100:00100000:3.0:1789518062.197401:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789518062.197413:0:6652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627433216:12345-0@lo:13: 00002000:00000024:3.0:1789518062.197507:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789518062.197565:0:6652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627433216:12345-0@lo:13: Request processed in 154us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518062.197574:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789518062.197602:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789518062.197713:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffc6503b80 x1876445627433216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518062.197735:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627433216:0@lo:13: 00000001:00080000:3.0:1789518062.238829:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1789518063.027508:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518063.730899:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789518063.730984:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789518063.731004:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627433728:0@lo:400: 00000100:00100000:2.0:1789518063.731028:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6501c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627433472:0@lo:400: 00000100:00100000:3.0:1789518063.731076:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518063.731076:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518063.731128:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789518063.731136:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6501f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627433600:0@lo:400: 00000100:00100000:2.0:1789518063.731160:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518063.731181:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627433472 00000100:00100000:3.0:1789518063.731189:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627433472 00000100:00100000:2.0:1789518063.731210:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627433600 00000100:00100000:2.0:1789518063.731216:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627433600 00000100:00100000:3.0:1789518063.731234:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789518063.731244:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627433472:12345-0@lo:400: 00000100:00100000:2.0:1789518063.731251:0:5811:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789518063.731260:0:5811:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789518063.731286:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789518063.731300:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627433472:12345-0@lo:400: Request processed in 55us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518063.731300:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789518063.731309:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627433600:12345-0@lo:400: 00000100:00100000:3.0:1789518063.731313:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1789518063.731339:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518063.731351:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627433600:12345-0@lo:400: Request processed in 43us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518063.731371:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1789518063.731379:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffc6501f80 x1876445627433600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518063.731392:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6501f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627433600:0@lo:400: 00000100:00100000:2.0:1789518063.731397:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627433728 00000100:00100000:2.0:1789518063.731403:0:6649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627433728 00010000:00080000:3.0:1789518063.731415:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffc6501c00 x1876445627433472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518063.731424:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6501c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627433472:0@lo:400: 00000100:00100000:2.0:1789518063.731432:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789518063.731440:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627433728:12345-0@lo:400: 00000100:00100000:2.0:1789518063.731480:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627433728:12345-0@lo:400: Request processed in 41us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518063.731487:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789518063.731560:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffc6503100 x1876445627433728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518063.731567:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789518063.731578:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627433728:0@lo:400: 00000100:00100000:1.0:1789518063.731911:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6502300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:824c8f07-28fa-48fd-81af-173b194570e6:3282:1876445627433344:0@lo:400: 00000100:00100000:1.0:1789518063.731945:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518063.732014:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627433344 00000100:00100000:2.0:1789518063.732019:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627433344 00000100:00100000:2.0:1789518063.732052:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789518063.732059:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+13:3282:x1876445627433344:12345-0@lo:400: 00000100:00100000:2.0:1789518063.732105:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+13:3282:x1876445627433344:12345-0@lo:400: Request processed in 47us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518063.732112:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789518063.732223:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6502300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:824c8f07-28fa-48fd-81af-173b194570e6:3282:1876445627433344:0@lo:400: 00000100:00100000:0.0:1789518063.732445:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627433856:0@lo:400: 00000100:00100000:0.0:1789518063.732476:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518063.732527:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627433856 00000100:00100000:2.0:1789518063.732532:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627433856 00000100:00080000:0.0:1789518063.732578:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518063.732583:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789518063.732592:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627433856:12345-0@lo:400: 00000100:00100000:2.0:1789518063.732648:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627433856:12345-0@lo:400: Request processed in 57us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518063.732653:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1789518063.733094:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffc6502a00 x1876445627433856/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518063.733105:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627433856:0@lo:400: 00010000:00010000:2.0:1789518064.050726:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518065.074680:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789518065.267902:0:5810:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789518065.267909:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99ffc76f3000 from 30 10000000:01000000:0.0:1789518065.267914:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789518065.267950:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc0030e00/0x631fd8698c780b8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518065.267962:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffc0030e00/0x631fd8698c780b8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518065.267984:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc0030e00/0x631fd8698c780b8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518065.268005:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6502a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627433984:0@lo:101: 00000100:00100000:0.0:1789518065.268077:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518065.268131:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc9247c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789518065.268194:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627433984 00000100:00100000:1.0:1789518065.268202:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627433984 00000100:00100000:1.0:1789518065.268274:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789518065.268283:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+13:5810:x1876445627433984:12345-0@lo:101: 00010000:00010000:1.0:1789518065.268295:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518065.268306:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc29e0200/0x631fd8698c780b91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780b8a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518065.268328:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc29e0200/0x631fd8698c780b91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780b8a expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518065.268337:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc29e0200/0x631fd8698c780b91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780b8a expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518065.268365:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e0200, rc 0) 00000100:00100000:1.0:1789518065.268401:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+14:5810:x1876445627433984:12345-0@lo:101: Request processed in 119us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518065.268407:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789518065.268587:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6502a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627433984:0@lo:101: 00010000:00010000:0.0:1789518065.268602:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc0030e00/0x631fd8698c780b8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780b91 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518065.268634:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc0030e00/0x631fd8698c780b8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780b91 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518065.268684:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6502a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627434112:0@lo:501: 00000100:00100000:0.0:1789518065.268709:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518065.268730:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc9247c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518065.268746:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627434112 00000100:00100000:0.0:1789518065.268750:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627434112 00000100:00100000:0.0:1789518065.268771:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789518065.268778:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+14:5810:x1876445627434112:12345-0@lo:501: 00000100:00100000:0.0:1789518065.270899:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+14:5810:x1876445627434112:12345-0@lo:501: Request processed in 2115us (2183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518065.270920:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789518065.272129:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6502a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627434112:0@lo:501: 00000100:00100000:2.0:1789518065.272179:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627434240:0@lo:503: 00000100:00100000:2.0:1789518065.272234:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518065.272276:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0d64a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789518065.272464:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627434240 00000100:00100000:0.0:1789518065.272471:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627434240 00000100:00100000:0.0:1789518065.272522:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789518065.272532:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+14:5810:x1876445627434240:12345-0@lo:503: 00000100:00100000:0.0:1789518065.272926:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+14:5810:x1876445627434240:12345-0@lo:503: Request processed in 396us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518065.272935:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789518065.273025:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627434240:0@lo:503: 00000100:00100000:1.0:1789518065.274013:0:8163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4001c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8163:1876445627434368:0@lo:502: 00000100:00100000:1.0:1789518065.274064:0:8163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518065.274111:0:8163:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7801f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789518065.274119:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627434368 00000100:00100000:2.0:1789518065.274127:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627434368 00000100:00100000:2.0:1789518065.274165:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789518065.274173:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+14:8163:x1876445627434368:12345-0@lo:502: 00000100:00100000:2.0:1789518065.274508:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+14:8163:x1876445627434368:12345-0@lo:502: Request processed in 335us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518065.274516:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789518065.275344:0:8163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4001c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8163:1876445627434368:0@lo:502: 00000100:00100000:1.0:1789518065.275403:0:8163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4001c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8163:1876445627434496:0@lo:502: 00000100:00100000:1.0:1789518065.275436:0:8163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518065.275465:0:8163:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7801f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518065.275486:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627434496 00000100:00100000:0.0:1789518065.275492:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627434496 00000100:00100000:0.0:1789518065.275526:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789518065.275534:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+14:8163:x1876445627434496:12345-0@lo:502: 00000100:00100000:0.0:1789518065.275707:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+14:8163:x1876445627434496:12345-0@lo:502: Request processed in 173us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518065.275715:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789518065.276079:0:8163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4001c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8163:1876445627434496:0@lo:502: 00000040:00080000:1.0:1789518065.276100:0:8163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789518065.276429:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789518065.276450:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789518065.276460:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc0030e00/0x631fd8698c780b8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780b91 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518065.276471:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc0030e00/0x631fd8698c780b8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780b91 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518065.276481:0:5810:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789518065.276484:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1789518065.276487:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789518065.276508:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16e00/0x631fd8698c780b98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518065.276517:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16e00/0x631fd8698c780b98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518065.276526:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16e00/0x631fd8698c780b98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518065.276540:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0793100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627434624:0@lo:101: 00000100:00100000:3.0:1789518065.276574:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518065.276606:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbb5180 going to sleep for 11 seconds 00000100:00100000:0.0:1789518065.276803:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627434624 00000100:00100000:0.0:1789518065.276808:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627434624 00000100:00100000:0.0:1789518065.276833:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789518065.276841:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+14:5810:x1876445627434624:12345-0@lo:101: 00010000:00010000:0.0:1789518065.276850:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518065.276862:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc0030000/0x631fd8698c780b9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780b98 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518065.276882:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc0030000/0x631fd8698c780b9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780b98 expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518065.276893:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc0030000/0x631fd8698c780b9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780b98 expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518065.276902:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc0030000, rc 0) 00000100:00100000:0.0:1789518065.277035:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+15:5810:x1876445627434624:12345-0@lo:101: Request processed in 193us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518065.277042:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789518065.277081:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0793100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627434624:0@lo:101: 00010000:00010000:0.0:1789518065.277094:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16e00/0x631fd8698c780b98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780b9f expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518065.277103:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16e00/0x631fd8698c780b98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780b9f expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518065.277143:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6502a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627434752:0@lo:501: 00000100:00100000:0.0:1789518065.277166:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518065.277185:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc9247a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789518065.277195:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627434752 00000100:00100000:0.0:1789518065.277198:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627434752 00000100:00100000:0.0:1789518065.277219:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789518065.277225:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+15:5810:x1876445627434752:12345-0@lo:501: 00000100:00100000:0.0:1789518065.279380:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+15:5810:x1876445627434752:12345-0@lo:501: Request processed in 2149us (2206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518065.279391:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789518065.279416:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6502a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627434752:0@lo:501: 00000100:00100000:2.0:1789518065.279458:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627434880:0@lo:503: 00000100:00100000:2.0:1789518065.279492:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518065.279520:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0d64780 going to sleep for 11 seconds 00000100:00100000:0.0:1789518065.279528:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627434880 00000100:00100000:0.0:1789518065.279534:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627434880 00000100:00100000:0.0:1789518065.279562:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789518065.279569:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+15:5810:x1876445627434880:12345-0@lo:503: 00000100:00100000:0.0:1789518065.279901:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+15:5810:x1876445627434880:12345-0@lo:503: Request processed in 331us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518065.279908:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789518065.280061:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627434880:0@lo:503: 00000100:00100000:0.0:1789518065.283157:0:8164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6502300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8164:1876445627435008:0@lo:502: 00000100:00100000:0.0:1789518065.283232:0:8164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518065.283273:0:8164:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc9247240 going to sleep for 11 seconds 00000100:00100000:1.0:1789518065.283372:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627435008 00000100:00100000:1.0:1789518065.283380:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627435008 00000100:00100000:1.0:1789518065.283418:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789518065.283426:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+15:8164:x1876445627435008:12345-0@lo:502: 00000100:00100000:1.0:1789518065.283669:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+15:8164:x1876445627435008:12345-0@lo:502: Request processed in 243us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518065.283677:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789518065.283765:0:8164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6502300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8164:1876445627435008:0@lo:502: 00000020:01000000:0.0:1789518065.283790:0:8164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518065.283797:0:8164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518065.283800:0:8164:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789518065.283805:0:8164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789518065.283807:0:8164:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789518065.283820:0:8164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6502300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8164:1876445627435136:0@lo:502: 00000100:00100000:0.0:1789518065.283851:0:8164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518065.283877:0:8164:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc9247240 going to sleep for 11 seconds 00000100:00100000:1.0:1789518065.283925:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627435136 00000100:00100000:1.0:1789518065.283930:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627435136 00000100:00100000:1.0:1789518065.283959:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789518065.283966:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+15:8164:x1876445627435136:12345-0@lo:502: 00000100:00100000:1.0:1789518065.284087:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+15:8164:x1876445627435136:12345-0@lo:502: Request processed in 121us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518065.284094:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789518065.284201:0:8164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6502300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8164:1876445627435136:0@lo:502: 00000020:01000000:0.0:1789518065.284216:0:8164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518065.284220:0:8164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518065.284222:0:8164:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789518065.284225:0:8164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1789518065.284359:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1789518065.284376:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789518065.284384:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16e00/0x631fd8698c780b98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780b9f expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518065.284396:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16e00/0x631fd8698c780b98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780b9f expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518065.284405:0:5810:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789518065.284408:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99ffc84db000 from 30 10000000:01000000:1.0:1789518065.284411:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789518065.284432:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0e00/0x631fd8698c780ba6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518065.284441:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0e00/0x631fd8698c780ba6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518065.284450:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0e00/0x631fd8698c780ba6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518065.284461:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4001c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627435264:0@lo:101: 00000100:00100000:1.0:1789518065.284486:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518065.284538:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7801840 going to sleep for 11 seconds 00000100:00100000:0.0:1789518065.284869:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627435264 00000100:00100000:0.0:1789518065.284873:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627435264 00000100:00100000:0.0:1789518065.284935:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789518065.284943:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+15:5810:x1876445627435264:12345-0@lo:101: 00010000:00010000:0.0:1789518065.284951:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518065.284962:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780bad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780ba6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518065.284982:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780bad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780ba6 expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518065.284991:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780bad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780ba6 expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518065.284999:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc0030a00, rc 0) 00000100:00100000:0.0:1789518065.285033:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+16:5810:x1876445627435264:12345-0@lo:101: Request processed in 91us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518065.285039:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789518065.285187:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4001c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627435264:0@lo:101: 00010000:00010000:1.0:1789518065.285199:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0e00/0x631fd8698c780ba6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780bad expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518065.285217:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0e00/0x631fd8698c780ba6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780bad expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518065.285259:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4001c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627435392:0@lo:501: 00000100:00100000:1.0:1789518065.285290:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518065.285374:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7801840 going to sleep for 11 seconds 00000100:00100000:3.0:1789518065.285403:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627435392 00000100:00100000:3.0:1789518065.285408:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627435392 00000100:00100000:3.0:1789518065.285508:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789518065.285516:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+16:5810:x1876445627435392:12345-0@lo:501: 00000100:00100000:3.0:1789518065.286112:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+16:5810:x1876445627435392:12345-0@lo:501: Request processed in 595us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518065.286119:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789518065.286176:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4001c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627435392:0@lo:501: 00000100:00100000:1.0:1789518065.286201:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4001c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627435520:0@lo:503: 00000100:00100000:1.0:1789518065.286234:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518065.286263:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7801840 going to sleep for 11 seconds 00000100:00100000:2.0:1789518065.286275:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627435520 00000100:00100000:2.0:1789518065.286285:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627435520 00000100:00100000:2.0:1789518065.286315:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789518065.286321:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+16:5810:x1876445627435520:12345-0@lo:503: 00000100:00100000:2.0:1789518065.286478:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+16:5810:x1876445627435520:12345-0@lo:503: Request processed in 156us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518065.286485:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789518065.286523:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4001c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627435520:0@lo:503: 00000100:00100000:3.0:1789518065.286861:0:8165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0793100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8165:1876445627435648:0@lo:502: 00000100:00100000:3.0:1789518065.286893:0:8165:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518065.286959:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627435648 00000100:00100000:0.0:1789518065.286964:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627435648 00000100:00100000:0.0:1789518065.286995:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789518065.287002:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+16:8165:x1876445627435648:12345-0@lo:502: 00000100:00100000:0.0:1789518065.287145:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+16:8165:x1876445627435648:12345-0@lo:502: Request processed in 143us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518065.287151:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789518065.287239:0:8165:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbb5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789518065.287251:0:8165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0793100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8165:1876445627435648:0@lo:502: 00000100:00100000:3.0:1789518065.287288:0:8165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0793100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8165:1876445627435776:0@lo:502: 00000100:00100000:3.0:1789518065.287318:0:8165:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518065.287340:0:8165:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbb5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789518065.287582:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627435776 00000100:00100000:1.0:1789518065.287587:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627435776 00000100:00100000:1.0:1789518065.287611:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789518065.287634:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+16:8165:x1876445627435776:12345-0@lo:502: 00000100:00100000:1.0:1789518065.287760:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+16:8165:x1876445627435776:12345-0@lo:502: Request processed in 127us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518065.287766:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789518065.288381:0:8165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0793100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8165:1876445627435776:0@lo:502: 00000040:00080000:3.0:1789518065.288402:0:8165:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789518065.288591:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789518065.288608:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789518065.288743:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0e00/0x631fd8698c780ba6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780bad expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518065.288754:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0e00/0x631fd8698c780ba6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780bad expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518065.288763:0:5810:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789518065.288765:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99ffc84db000 from 5 10000000:01000000:0.0:1789518065.288768:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789518065.288793:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc0030800/0x631fd8698c780bb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518065.288801:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffc0030800/0x631fd8698c780bb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518065.288809:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc0030800/0x631fd8698c780bb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518065.288832:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6502300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627435904:0@lo:101: 00000100:00100000:0.0:1789518065.288863:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518065.288884:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc9247480 going to sleep for 11 seconds 00000100:00100000:0.0:1789518065.288896:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627435904 00000100:00100000:0.0:1789518065.288900:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627435904 00000100:00100000:0.0:1789518065.288926:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789518065.288938:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+16:5810:x1876445627435904:12345-0@lo:101: 00010000:00010000:0.0:1789518065.288947:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518065.288969:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc28dc00/0x631fd8698c780bbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780bb4 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518065.288989:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc28dc00/0x631fd8698c780bbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780bb4 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518065.288999:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc28dc00/0x631fd8698c780bbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780bb4 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518065.289008:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28dc00, rc 0) 00000100:00100000:0.0:1789518065.289040:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+17:5810:x1876445627435904:12345-0@lo:101: Request processed in 107us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518065.289046:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789518065.289084:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6502300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627435904:0@lo:101: 00010000:00010000:3.0:1789518065.289096:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc0030800/0x631fd8698c780bb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780bbb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518065.289105:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc0030800/0x631fd8698c780bb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780bbb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518065.289154:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0793100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627436032:0@lo:256: 00000100:00100000:3.0:1789518065.289183:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518065.289205:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbb5480 going to sleep for 11 seconds 00000100:00100000:1.0:1789518065.289245:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627436032 00000100:00100000:1.0:1789518065.289250:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627436032 00000100:00100000:1.0:1789518065.289285:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789518065.289292:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+17:5810:x1876445627436032:12345-0@lo:256: 20000000:01000000:1.0:1789518065.289305:0:5807:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789518065.289319:0:5807:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789518065.289322:0:5807:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1789518065.289416:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+17:5810:x1876445627436032:12345-0@lo:256: Request processed in 124us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518065.289430:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789518065.289461:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0793100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627436032:0@lo:256: 10000000:01000000:1.0:1789518065.289498:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789518065.289503:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc0030800/0x631fd8698c780bb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780bbb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518065.289511:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc0030800/0x631fd8698c780bb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780bbb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518065.289518:0:5810:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789518065.289520:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1789518065.289522:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789518065.289537:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c780bc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518065.289544:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c780bc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518065.289551:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c780bc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518065.289563:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4003b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627436160:0@lo:101: 00000100:00100000:1.0:1789518065.289587:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518065.289599:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff78010c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518065.291073:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627436160 00000100:00100000:0.0:1789518065.291081:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627436160 00000100:00100000:0.0:1789518065.291121:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789518065.291130:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+17:5810:x1876445627436160:12345-0@lo:101: 00010000:00010000:0.0:1789518065.291140:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518065.291151:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc28c200/0x631fd8698c780bc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780bc2 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518065.291181:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc28c200/0x631fd8698c780bc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780bc2 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518065.291189:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc28c200/0x631fd8698c780bc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780bc2 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518065.291197:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28c200, rc 0) 00000100:00100000:0.0:1789518065.291253:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+18:5810:x1876445627436160:12345-0@lo:101: Request processed in 124us (1664us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518065.291259:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789518065.291336:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4003b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627436160:0@lo:101: 00010000:00010000:2.0:1789518065.291362:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c780bc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780bc9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518065.291371:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c780bc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780bc9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518065.291423:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627436288:0@lo:501: 00000100:00100000:2.0:1789518065.291450:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518065.291490:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0d64480 going to sleep for 11 seconds 00000100:00100000:1.0:1789518065.291716:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627436288 00000100:00100000:1.0:1789518065.291721:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627436288 00000100:00100000:1.0:1789518065.291751:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789518065.291758:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+18:5810:x1876445627436288:12345-0@lo:501: 00000100:00100000:1.0:1789518065.291949:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+18:5810:x1876445627436288:12345-0@lo:501: Request processed in 191us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518065.291955:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789518065.291977:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627436288:0@lo:501: 00000100:00100000:2.0:1789518065.292004:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627436416:0@lo:503: 00000100:00100000:2.0:1789518065.292039:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518065.292098:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0d64480 going to sleep for 11 seconds 00000100:00100000:0.0:1789518065.292132:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627436416 00000100:00100000:0.0:1789518065.292136:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627436416 00000100:00100000:0.0:1789518065.292199:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789518065.292207:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+18:5810:x1876445627436416:12345-0@lo:503: 00000100:00100000:0.0:1789518065.292505:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+18:5810:x1876445627436416:12345-0@lo:503: Request processed in 298us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518065.292511:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789518065.292775:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627436416:0@lo:503: 00000100:00100000:3.0:1789518065.298251:0:8166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0792680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8166:1876445627436544:0@lo:502: 00000100:00100000:3.0:1789518065.298328:0:8166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518065.298376:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627436544 00000100:00100000:3.0:1789518065.298383:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627436544 00000100:00100000:3.0:1789518065.298420:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789518065.298429:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+18:8166:x1876445627436544:12345-0@lo:502: 00000100:00100000:3.0:1789518065.298773:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+18:8166:x1876445627436544:12345-0@lo:502: Request processed in 344us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518065.298780:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789518065.298825:0:8166:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbb5840 going to sleep for 11 seconds 00000100:00100000:3.0:1789518065.298843:0:8166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0792680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8166:1876445627436544:0@lo:502: 00000020:01000000:3.0:1789518065.298868:0:8166:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789518065.298875:0:8166:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789518065.298880:0:8166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518065.298883:0:8166:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789518065.298887:0:8166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789518065.298891:0:8166:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:01000000:3.0:1789518065.298917:0:8166:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789518065.298920:0:8166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789518065.298931:0:8166:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99ffc64a0000) 00000020:00000080:3.0:1789518065.298950:0:8166:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1789518065.298959:0:8166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789518065.299022:0:8166:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789518065.299028:0:8166:0:(osd_handler.c:1614:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789518065.299034:0:8166:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c780bd7 00010000:00080000:3.0:1789518065.299060:0:8166:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ffdf98e800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:3.0:1789518065.299419:0:8166:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1789518065.299781:0:8166:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1789518065.299791:0:8166:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789518065.300232:0:8166:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789518065.300436:0:8166:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789518065.300482:0:8166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1789518065.300539:0:8166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1789518065.302521:0:8167:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789518065.302527:0:8167:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789518065.303966:0:8166:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789518065.303978:0:8166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789518065.304007:0:8166:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789518065.304029:0:8166:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x631fd8698c780bde 00000100:00080000:3.0:1789518065.304038:0:8166:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789518065.304046:0:8166:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99ffdf98e800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1789518065.304077:0:8166:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffd0792680 x1876445627436672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789518065.304103:0:8166:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789518065.304158:0:8166:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518065.304163:0:8166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518065.304165:0:8166:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789518065.304168:0:8166:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518065.304172:0:8166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518065.304174:0:8166:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789518065.304176:0:8166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789518065.304178:0:8166:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789518065.304202:0:8166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0790000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8166:1876445627436800:0@lo:502: 00000100:00100000:3.0:1789518065.304251:0:8166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518065.304286:0:8166:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbb59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518065.304471:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0790a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627436928:0@lo:400: 00000100:00100000:3.0:1789518065.304485:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627436800 00000100:00100000:3.0:1789518065.304490:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627436800 00000100:00100000:0.0:1789518065.304500:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518065.304520:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518065.304521:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789518065.304525:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0793b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627437056:0@lo:400: 00000100:00100000:3.0:1789518065.304529:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+18:8166:x1876445627436800:12345-0@lo:502: 00000100:00100000:0.0:1789518065.304544:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518065.304897:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0792680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627436672:0@lo:8: 00000100:00100000:1.0:1789518065.304938:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518065.305058:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627436672 00000100:00100000:2.0:1789518065.305062:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627436672 00000100:00100000:2.0:1789518065.305092:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789518065.305097:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4002d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3279:x1876445627436672:12345-0@lo:8: 00010000:00080000:2.0:1789518065.305116:0:6648:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 119 last 0 00000020:00000080:2.0:1789518065.305145:0:6648:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x631fd8698c780be5 00002000:00100000:2.0:1789518065.305157:0:6648:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99ffc76f2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789518065.305161:0:6648:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1789518065.305164:0:6648:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789518065.305251:0:6648:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789518065.305399:0:6648:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789518065.305423:0:6648:0:(import.c:65:import_set_state_nolock()) ffff99fff4016000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789518065.305466:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4002d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3279:x1876445627436672:12345-0@lo:8: Request processed in 367us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518065.305473:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789518065.305517:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffd0792680 x1876445627436672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789518075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518065.305528:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789518065.305535:0:3279:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789518065.305541:0:3279:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789518065.305546:0:3279:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789518065.305548:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffdf98e800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789518065.305557:0:3279:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789518065.305561:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0792680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627436672:0@lo:8: 00000004:00080000:2.0:1789518065.305587:0:8167:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789518065.305712:0:8167:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 119302097716ns, next at 0ns, rc = 0 00000100:00100000:2.0:1789518065.305864:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627437312:0@lo:400: 00000100:00100000:2.0:1789518065.305893:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518065.305922:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789518065.305928:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0793100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627437184:0@lo:400: 00000100:00100000:2.0:1789518065.305949:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518065.306059:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627436928 00000100:00100000:1.0:1789518065.306064:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627436928 00000100:00100000:1.0:1789518065.306097:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627437056 00000100:00100000:1.0:1789518065.306101:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627437056 00000100:00100000:1.0:1789518065.306119:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627437312 00000100:00100000:1.0:1789518065.306121:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627437312 00000100:00100000:1.0:1789518065.306133:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789518065.306139:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627436928:12345-0@lo:400: 00000100:00100000:1.0:1789518065.306176:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627436928:12345-0@lo:400: Request processed in 37us (1675us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518065.306182:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789518065.306195:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789518065.306200:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627437056:12345-0@lo:400: 00000100:00100000:1.0:1789518065.306224:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627437056:12345-0@lo:400: Request processed in 25us (1679us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518065.306229:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789518065.306240:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789518065.306245:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627437312:12345-0@lo:400: 00000100:00100000:1.0:1789518065.306273:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627437312:12345-0@lo:400: Request processed in 28us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518065.306278:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1789518065.306292:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789518065.306320:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fff79aea00 x1876445627437312/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518065.306330:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627437312:0@lo:400: 00010000:00080000:1.0:1789518065.306368:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffd0793b80 x1876445627437056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518065.306376:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0793b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627437056:0@lo:400: 00010000:00080000:1.0:1789518065.306390:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffd0790a80 x1876445627436928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518065.306398:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0790a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627436928:0@lo:400: 00000100:00100000:3.0:1789518065.310087:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+18:8166:x1876445627436800:12345-0@lo:502: Request processed in 5550us (5828us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518065.310096:0:8166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0790000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8166:1876445627436800:0@lo:502: 00000100:00100000:3.0:1789518065.310100:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000020:01000000:0.0:1789518065.310150:0:8166:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518065.310156:0:8166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518065.310158:0:8166:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789518065.310171:0:8166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:3.0:1789518065.310250:0:6647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627437184 00000100:00100000:3.0:1789518065.310256:0:6647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627437184 00000020:01000000:0.0:1789518065.310273:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1789518065.310289:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789518065.310297:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c780bc2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780bc9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518065.310307:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c780bc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780bc9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518065.310317:0:5810:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789518065.310319:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99ffc64a4d40 from 1 10000000:01000000:0.0:1789518065.310322:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789518065.310359:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c780bec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518065.310368:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c780bec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518065.310381:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c780bec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518065.310398:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6501f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627437440:0@lo:101: 00000100:00100000:0.0:1789518065.310444:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518065.310470:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc92473c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518065.310502:0:6647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789518065.310511:0:6647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627437184:12345-0@lo:400: 00000100:00100000:3.0:1789518065.310568:0:6647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627437184:12345-0@lo:400: Request processed in 59us (4618us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518065.310575:0:6647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789518065.311025:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffd0793100 x1876445627437184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518065.311036:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0793100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627437184:0@lo:400: 00000100:00100000:3.0:1789518065.312116:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00080000:3.0:1789518065.312141:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518065.312164:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627437440 00000100:00100000:3.0:1789518065.312171:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627437440 00000100:00100000:3.0:1789518065.312210:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616930944 00000100:00100000:3.0:1789518065.312214:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616930944 00000100:00100000:3.0:1789518065.312231:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789518065.312240:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+18:5810:x1876445627437440:12345-0@lo:101: 00010000:00010000:3.0:1789518065.312252:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518065.312265:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc6b17c00/0x631fd8698c780bf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780bec expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518065.312288:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc6b17c00/0x631fd8698c780bf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780bec expref: 19 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518065.312326:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc6b17c00/0x631fd8698c780bf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780bec expref: 19 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518065.312340:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17c00, rc 0) 00000100:00100000:3.0:1789518065.312398:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+19:5810:x1876445627437440:12345-0@lo:101: Request processed in 159us (1952us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518065.312405:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789518065.312434:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 107 00000100:00100000:3.0:1789518065.312440:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2341:x1876445616930944:12345-192.168.206.51@tcp:250: 00010000:00080000:3.0:1789518065.312458:0:5806:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 2e55716f-fc49-42ce-abad-050985078c82@192.168.206.51@tcp t0 exp 0000000000000000 cur 119 last 0 00000020:00000080:3.0:1789518065.312486:0:5806:0:(genops.c:1384:class_connect()) connect: client 2e55716f-fc49-42ce-abad-050985078c82, cookie 0x631fd8698c780bfa 00000100:00080000:3.0:1789518065.313061:0:5806:0:(import.c:65:import_set_state_nolock()) ffff99fff415e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789518065.313108:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+5:2341:x1876445616930944:12345-192.168.206.51@tcp:250: Request processed in 666us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518065.313116:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 107 00000100:00100000:3.0:1789518065.314751:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6501f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627437440:0@lo:101: 00010000:00010000:3.0:1789518065.314773:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c780bec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780bf3 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518065.314786:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c780bec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780bf3 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518065.314860:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627437568:0@lo:501: 00000100:00100000:3.0:1789518065.314901:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518065.314932:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbb5600 going to sleep for 11 seconds 00000100:00100000:3.0:1789518065.314956:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627437568 00000100:00100000:3.0:1789518065.314962:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627437568 00000100:00100000:2.0:1789518065.315235:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789518065.315246:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+19:5810:x1876445627437568:12345-0@lo:501: 00000100:00100000:2.0:1789518065.315436:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+19:5810:x1876445627437568:12345-0@lo:501: Request processed in 192us (534us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789518065.315444:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789518065.316291:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518065.316314:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616931072 00000100:00100000:2.0:1789518065.316319:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616931072 00000100:00100000:2.0:1789518065.316340:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 109 00000100:00100000:2.0:1789518065.316347:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc777b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+5:5565:x1876445616931072:12345-192.168.206.51@tcp:101: 00010000:00010000:2.0:1789518065.316367:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518065.316380:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780c01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc5d8 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518065.316399:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780c01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc5d8 expref: 6 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518065.316409:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780c01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc5d8 expref: 6 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518065.316417:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29c8800, rc 0) 00000100:00100000:2.0:1789518065.316449:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc777b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+6:5565:x1876445616931072:12345-192.168.206.51@tcp:101: Request processed in 102us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518065.316476:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 109 00000100:00100000:3.0:1789518065.317523:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627437568:0@lo:501: 10000000:01000000:3.0:1789518065.317561:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789518065.317570:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c780bec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780bf3 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518065.317581:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c780bec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780bf3 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518065.321748:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518065.321793:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616931200 00000100:00100000:1.0:1789518065.321803:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616931200 00000100:00100000:1.0:1789518065.321848:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 110 00000100:00100000:1.0:1789518065.321857:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc777bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+6:5565:x1876445616931200:12345-192.168.206.51@tcp:501: 00000100:00100000:1.0:1789518065.322032:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc777bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+6:5565:x1876445616931200:12345-192.168.206.51@tcp:501: Request processed in 175us (290us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789518065.322041:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 110 00000100:00100000:3.0:1789518065.324167:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518065.324199:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616931328 00000100:00100000:0.0:1789518065.324206:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616931328 00000100:00100000:0.0:1789518065.324251:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 111 00000100:00100000:0.0:1789518065.324266:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc777a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+6:5565:x1876445616931328:12345-192.168.206.51@tcp:101: 00010000:00010000:0.0:1789518065.324278:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518065.324292:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc28c800/0x631fd8698c780c08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc5df expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518065.324314:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc28c800/0x631fd8698c780c08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc5df expref: 7 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518065.324342:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc28c800/0x631fd8698c780c08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc5df expref: 7 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518065.324364:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28c800, rc 0) 00000100:00100000:0.0:1789518065.324451:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc777a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+7:5565:x1876445616931328:12345-192.168.206.51@tcp:101: Request processed in 185us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518065.324458:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 111 00000100:00100000:3.0:1789518065.327286:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518065.327482:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616931456 00000100:00100000:2.0:1789518065.327490:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616931456 00000100:00100000:2.0:1789518065.327532:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 112 00000100:00100000:2.0:1789518065.327541:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7779c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+7:5565:x1876445616931456:12345-192.168.206.51@tcp:501: 00000100:00100000:2.0:1789518065.327762:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7779c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+8:5565:x1876445616931456:12345-192.168.206.51@tcp:501: Request processed in 222us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518065.327771:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 112 00000100:00100000:3.0:1789518065.329226:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518065.329290:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616931584 00000100:00100000:1.0:1789518065.329297:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616931584 00000100:00100000:1.0:1789518065.329338:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 113 00000100:00100000:1.0:1789518065.329347:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+8:5565:x1876445616931584:12345-192.168.206.51@tcp:503: 00000100:00100000:1.0:1789518065.329528:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+8:5565:x1876445616931584:12345-192.168.206.51@tcp:503: Request processed in 182us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518065.329535:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 113 00000100:00100000:0.0:1789518065.336238:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518065.336851:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616931712 00000100:00100000:3.0:1789518065.336914:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616931712 00000100:00100000:3.0:1789518065.336982:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 114 00000100:00100000:3.0:1789518065.337000:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc777a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+8:5584:x1876445616931712:12345-192.168.206.51@tcp:502: 00000100:00100000:3.0:1789518065.337497:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc777a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+8:5584:x1876445616931712:12345-192.168.206.51@tcp:502: Request processed in 502us (1265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518065.337507:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 114 00000001:00100000:1.0:1789518065.338810:0:7607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:00080000:1.0:1789518065.351141:0:8168:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1789518065.351179:0:8168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4001c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8168:1876445627437824:0@lo:7: 00000100:00100000:1.0:1789518065.351238:0:8168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518065.351284:0:8168:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc76c4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789518065.351299:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4003b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627437696:0@lo:13: 00000100:00100000:1.0:1789518065.351323:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518065.351384:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627437824 00000100:00100000:1.0:1789518065.351390:0:6649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627437824 00000100:00100000:1.0:1789518065.351438:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789518065.351447:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4000a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8168:x1876445627437824:12345-0@lo:7: 00000004:00080000:3.0:1789518065.351894:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1789518065.351941:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627437696 00000100:00100000:3.0:1789518065.351946:0:6652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627437696 00000100:00100000:3.0:1789518065.351974:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789518065.351982:0:6652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4003480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627437696:12345-0@lo:13: 00002000:00000024:3.0:1789518065.352003:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1789518065.352050:0:6652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4003480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627437696:12345-0@lo:13: Request processed in 69us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518065.352063:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789518065.352082:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789518065.352460:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fff4003b80 x1876445627437696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518081 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518065.352478:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4003b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627437696:0@lo:13: 00000100:00100000:3.0:1789518065.352540:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518065.352570:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616931840 00000100:00100000:3.0:1789518065.352574:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616931840 00000100:00100000:3.0:1789518065.352601:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 115 00000100:00100000:3.0:1789518065.352608:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7779450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+8:5584:x1876445616931840:12345-192.168.206.51@tcp:502: 00000100:00100000:3.0:1789518065.352837:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7779450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+8:5584:x1876445616931840:12345-192.168.206.51@tcp:502: Request processed in 228us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518065.352844:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 115 00002000:00080000:1.0:1789518065.357142:0:6649:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1789518065.357150:0:6649:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789518065.357393:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4000a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8168:x1876445627437824:12345-0@lo:7: Request processed in 5943us (6150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518065.357403:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789518065.357438:0:8168:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fff4001c00 x1876445627437824/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789518081 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518065.357451:0:8168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4001c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8168:1876445627437824:0@lo:7: 00000004:00080000:2.0:1789518065.357463:0:8168:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1789518065.357496:0:8168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8168:1876445627437952:0@lo:5: 00000100:00100000:2.0:1789518065.357527:0:8168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518065.357560:0:8168:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd80a03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518065.357574:0:6647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627437952 00000100:00100000:2.0:1789518065.357578:0:6647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627437952 00000100:00100000:2.0:1789518065.357631:0:6647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789518065.357645:0:6647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8168:x1876445627437952:12345-0@lo:5: 00002000:00080000:2.0:1789518065.357666:0:6647:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789518065.357669:0:6647:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1789518065.357986:0:6647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8168:x1876445627437952:12345-0@lo:5: Request processed in 342us (458us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789518065.357993:0:6647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789518065.358050:0:8168:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffd846e300 x1876445627437952/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789518081 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518065.358068:0:8168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8168:1876445627437952:0@lo:5: 00000004:00080000:0.0:1789518065.358082:0:8168:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789518065.358108:0:8168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6503b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8168:1876445627438080:0@lo:700: 00000100:00100000:0.0:1789518065.358410:0:8168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518065.358432:0:8168:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7801480 going to sleep for 11 seconds 00000100:00100000:0.0:1789518065.358449:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627438080 00000100:00100000:0.0:1789518065.358453:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627438080 00000100:00100000:0.0:1789518065.358486:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789518065.358495:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6503480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:8168:x1876445627438080:12345-0@lo:700: 00000100:00100000:0.0:1789518065.358533:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6502d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6656:1876445627438208:0@lo:700: 00000100:00100000:0.0:1789518065.358566:0:6656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518065.358588:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff78010c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518065.358610:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627438208 00000100:00100000:0.0:1789518065.358645:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627438208 00000100:00100000:0.0:1789518065.358680:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789518065.358688:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6656:x1876445627438208:12345-0@lo:700: 00000100:00100000:3.0:1789518065.364537:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518065.364568:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616931968 00000100:00100000:3.0:1789518065.364577:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616931968 00000100:00100000:3.0:1789518065.364806:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 116 00000100:00100000:3.0:1789518065.364817:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7778c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+8:5565:x1876445616931968:12345-192.168.206.51@tcp:101: 00010000:00010000:3.0:1789518065.364831:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518065.364847:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc6b16200/0x631fd8698c780c0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc609 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518065.366499:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc6b16200/0x631fd8698c780c0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc609 expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518065.366514:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc6b16200/0x631fd8698c780c0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc609 expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518065.366531:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16200, rc 0) 00000100:00100000:3.0:1789518065.366610:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7778c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+9:5565:x1876445616931968:12345-192.168.206.51@tcp:101: Request processed in 1794us (2079us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518065.366634:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 116 00000100:00100000:0.0:1789518065.371660:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518065.371890:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616932096 00000100:00100000:3.0:1789518065.371900:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616932096 00000100:00100000:3.0:1789518065.371952:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 117 00000100:00100000:3.0:1789518065.371962:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7778050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+9:5565:x1876445616932096:12345-192.168.206.51@tcp:256: 20000000:01000000:3.0:1789518065.371985:0:5805:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789518065.372000:0:5805:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789518065.372004:0:5805:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789518065.372007:0:5805:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789518065.372009:0:5805:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1789518065.379213:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7778050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+9:5565:x1876445616932096:12345-192.168.206.51@tcp:256: Request processed in 7242us (7553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518065.379227:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 117 00000100:00100000:2.0:1789518065.382478:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518065.382675:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616932224 00000100:00100000:0.0:1789518065.382684:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616932224 00000100:00100000:0.0:1789518065.382729:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 118 00000100:00100000:0.0:1789518065.382738:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7778450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+9:5565:x1876445616932224:12345-192.168.206.51@tcp:101: 00010000:00010000:0.0:1789518065.382754:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518065.382769:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc28d000/0x631fd8698c780c16 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc610 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518065.382795:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc28d000/0x631fd8698c780c16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc610 expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518065.382808:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc28d000/0x631fd8698c780c16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc610 expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518065.382817:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28d000, rc 0) 00000100:00100000:0.0:1789518065.382866:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7778450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+10:5565:x1876445616932224:12345-192.168.206.51@tcp:101: Request processed in 128us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518065.382873:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 118 40000000:02000000:0.0:1789518065.384011:0:5818:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1789518065.394931:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6656:x1876445627438208:12345-0@lo:700: Request processed in 36237us (36359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518065.394944:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789518065.395009:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00080000:1.0:1789518065.395092:0:6656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffc6502d80 x1876445627438208/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789518081 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518065.395106:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6502d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6656:1876445627438208:0@lo:700: 40000000:02000000:1.0:1789518065.395117:0:6656:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:3.0:1789518065.395652:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616932352 00000100:00100000:3.0:1789518065.395661:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616932352 00000100:00100000:3.0:1789518065.395697:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 119 00000100:00100000:3.0:1789518065.395854:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc777b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+10:5565:x1876445616932352:12345-192.168.206.51@tcp:501: 00000100:00100000:3.0:1789518065.396066:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc777b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+10:5565:x1876445616932352:12345-192.168.206.51@tcp:501: Request processed in 359us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518065.396073:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 119 00000100:00100000:1.0:1789518065.402548:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518065.402593:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616932480 00000100:00100000:0.0:1789518065.402602:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616932480 00000100:00100000:0.0:1789518065.402668:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 120 00000100:00100000:0.0:1789518065.402677:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+10:5565:x1876445616932480:12345-192.168.206.51@tcp:503: 00000100:00100000:0.0:1789518065.402990:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+10:5565:x1876445616932480:12345-192.168.206.51@tcp:503: Request processed in 312us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518065.402998:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 120 00000100:00100000:0.0:1789518065.406082:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518065.406300:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616932608 00000100:00100000:2.0:1789518065.406307:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616932608 00000100:00100000:2.0:1789518065.406360:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 121 00000100:00100000:2.0:1789518065.406370:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7779050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+10:5590:x1876445616932608:12345-192.168.206.51@tcp:502: 00000100:00100000:2.0:1789518065.406539:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7779050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+10:5590:x1876445616932608:12345-192.168.206.51@tcp:502: Request processed in 170us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518065.406556:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 121 00000100:00100000:0.0:1789518065.410074:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518065.410112:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616932736 00000100:00100000:0.0:1789518065.410120:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616932736 00000100:00100000:0.0:1789518065.410163:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 122 00000100:00100000:0.0:1789518065.410174:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc777a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+10:5590:x1876445616932736:12345-192.168.206.51@tcp:502: 00000100:00100000:0.0:1789518065.410517:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc777a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+10:5590:x1876445616932736:12345-192.168.206.51@tcp:502: Request processed in 345us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518065.410526:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 122 00000100:00100000:0.0:1789518065.416949:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518065.417172:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616932864 00000100:00100000:2.0:1789518065.417182:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616932864 00000100:00100000:2.0:1789518065.417223:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:2.0:1789518065.417297:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2341:x1876445616932864:12345-192.168.206.51@tcp:38: 00010000:00080000:2.0:1789518065.417329:0:5812:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from cfa1c47d-1425-4fe5-be2a-28ad5152a12d@192.168.206.51@tcp t0 exp 0000000000000000 cur 119 last 0 00000020:00000080:2.0:1789518065.417378:0:5812:0:(genops.c:1384:class_connect()) connect: client cfa1c47d-1425-4fe5-be2a-28ad5152a12d, cookie 0x631fd8698c780c1d 00000004:00100000:2.0:1789518065.417405:0:5812:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1789518065.417411:0:5812:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1789518065.423449:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00080000:2.0:1789518065.440478:0:5812:0:(import.c:65:import_set_state_nolock()) ffff99ffed82f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789518065.440547:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2341:x1876445616932864:12345-192.168.206.51@tcp:38: Request processed in 23314us (23605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518065.440557:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:0.0:1789518065.452334:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6503480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8168:x1876445627438080:12345-0@lo:700: Request processed in 93832us (93917us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518065.452348:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789518065.452396:0:8168:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffc6503b80 x1876445627438080/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789518081 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518065.452408:0:8168:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789518065.452425:0:8168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6503b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8168:1876445627438080:0@lo:700: 00000001:00100000:3.0:1789518065.487335:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cfa1c47d-1425-4fe5-be2a-28ad5152a12d 00000004:02000040:1.0:1789518065.487421:0:8168:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1789518065.492561:0:8168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4000000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8168:1876445627438336:0@lo:5: 00000100:00100000:1.0:1789518065.492663:0:8168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518065.492700:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627438336 00000100:00100000:0.0:1789518065.492709:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627438336 00000100:00100000:0.0:1789518065.492805:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789518065.492820:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4002a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8168:x1876445627438336:12345-0@lo:5: 00000100:00100000:1.0:1789518065.492985:0:8168:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffedb6c000 going to sleep for 11 seconds 00002000:00080000:1.0:1789518065.498155:0:6648:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1789518065.498174:0:6648:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1789518065.510685:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4002a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8168:x1876445627438336:12345-0@lo:5: Request processed in 17860us (18016us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789518065.510697:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789518065.510752:0:8168:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fff4000000 x1876445627438336/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789518081 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518065.510769:0:8168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4000000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8168:1876445627438336:0@lo:5: 00000004:00080000:2.0:1789518065.510784:0:8168:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000001:00080000:1.0:1789518065.565549:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1789518066.099148:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518066.444882:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518066.445132:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616933120 00000100:00100000:0.0:1789518066.445143:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616933120 00000100:00080000:3.0:1789518066.445291:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518066.446639:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:0.0:1789518066.446654:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:5565:x1876445616933120:12345-192.168.206.51@tcp:41: 00000004:00000024:0.0:1789518066.446691:0:5811:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789518066.446850:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:5565:x1876445616933120:12345-192.168.206.51@tcp:41: Request processed in 163us (1936us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518066.446858:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:2.0:1789518066.448573:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518066.449264:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616932992 00000100:00100000:0.0:1789518066.449273:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616932992 00000100:00100000:2.0:1789518066.449298:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518066.449321:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616933248 00000100:00100000:2.0:1789518066.449326:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616933248 00000100:00100000:0.0:1789518066.449425:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:0.0:1789518066.449435:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:0:x1876445616932992:12345-192.168.206.51@tcp:41: 00000004:00000024:0.0:1789518066.449458:0:5811:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789518066.449513:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:0:x1876445616932992:12345-192.168.206.51@tcp:41: Request processed in 79us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518066.449519:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:2.0:1789518066.452262:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:2.0:1789518066.452278:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:5565:x1876445616933248:12345-192.168.206.51@tcp:40: 00000100:00100000:2.0:1789518066.452366:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:5565:x1876445616933248:12345-192.168.206.51@tcp:40: Request processed in 93us (3068us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518066.452390:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:2.0:1789518066.455880:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518066.455935:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518066.455969:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518066.456097:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616933760 00000100:00100000:0.0:1789518066.456111:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616933760 00000100:00100000:3.0:1789518066.456167:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616933632 00000100:00100000:3.0:1789518066.456179:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616933632 00000100:00100000:0.0:1789518066.456179:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 123 00000100:00100000:0.0:1789518066.456201:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc777ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+10:2343:x1876445616933760:12345-192.168.206.51@tcp:400: 00000100:00100000:3.0:1789518066.456243:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:3.0:1789518066.456256:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:5565:x1876445616933632:12345-192.168.206.51@tcp:33: 00000100:00100000:0.0:1789518066.456279:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc777ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+10:2343:x1876445616933760:12345-192.168.206.51@tcp:400: Request processed in 84us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518066.456288:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 123 00000100:00100000:2.0:1789518066.457425:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518066.457952:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616933376 00000100:00100000:1.0:1789518066.457961:0:6649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616933376 00000100:00100000:1.0:1789518066.458041:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616933504 00000100:00100000:1.0:1789518066.458045:0:6649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616933504 00000100:00100000:3.0:1789518066.458156:0:6647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:3.0:1789518066.458165:0:6647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2341:x1876445616933376:12345-192.168.206.51@tcp:8: 00010000:00080000:3.0:1789518066.458196:0:6647:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from cfa1c47d-1425-4fe5-be2a-28ad5152a12d@192.168.206.51@tcp t0 exp 0000000000000000 cur 120 last 0 00000020:00000080:3.0:1789518066.458235:0:6647:0:(genops.c:1384:class_connect()) connect: client cfa1c47d-1425-4fe5-be2a-28ad5152a12d, cookie 0x631fd8698c780c24 00002000:00100000:3.0:1789518066.458248:0:6647:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cfa1c47d-1425-4fe5-be2a-28ad5152a12d/ffff99ffffbf7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789518066.458276:0:6647:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789518066.458721:0:6647:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789518066.458757:0:6647:0:(import.c:65:import_set_state_nolock()) ffff99ffffbf1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789518066.458834:0:6647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2341:x1876445616933376:12345-192.168.206.51@tcp:8: Request processed in 668us (2863us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518066.458842:0:6647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:3.0:1789518066.458864:0:6647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:3.0:1789518066.458869:0:6647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0793100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2341:x1876445616933504:12345-192.168.206.51@tcp:8: 00010000:00080000:3.0:1789518066.458887:0:6647:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from cfa1c47d-1425-4fe5-be2a-28ad5152a12d@192.168.206.51@tcp t0 exp 0000000000000000 cur 120 last 0 00000020:00000080:3.0:1789518066.458907:0:6647:0:(genops.c:1384:class_connect()) connect: client cfa1c47d-1425-4fe5-be2a-28ad5152a12d, cookie 0x631fd8698c780c2b 00002000:00100000:3.0:1789518066.458913:0:6647:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cfa1c47d-1425-4fe5-be2a-28ad5152a12d/ffff99ffee440000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789518066.458921:0:6647:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789518066.459137:0:6647:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789518066.459164:0:6647:0:(import.c:65:import_set_state_nolock()) ffff99ffc6bdf800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789518066.459198:0:6647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0793100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2341:x1876445616933504:12345-192.168.206.51@tcp:8: Request processed in 327us (1778us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518066.459205:0:6647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00000004:00080000:3.0:1789518066.471746:0:5814:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 15406us 00000004:00200000:1.0:1789518066.481390:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789518066.481541:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:5565:x1876445616933632:12345-192.168.206.51@tcp:33: Request processed in 25280us (25669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518066.481557:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:0.0:1789518066.634920:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518066.635406:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616933888 00000100:00100000:1.0:1789518066.635420:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616933888 00000100:00100000:1.0:1789518066.635503:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:1.0:1789518066.635515:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:5607:x1876445616933888:12345-192.168.206.51@tcp:101: 00010000:00010000:1.0:1789518066.635542:0:8051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518066.635572:0:8051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0000/0x631fd8698c780c32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc63a expref: -99 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518066.635717:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0a00/0x631fd8698c780c39 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518066.635734:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0a00/0x631fd8698c780c39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518066.635784:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0a00/0x631fd8698c780c39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518066.635825:0:8051:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789518066.635828:0:8051:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518066.635844:0:8051:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0a00/0x631fd8698c780c39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518066.635868:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0000/0x631fd8698c780c32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc63a expref: 7 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518066.635884:0:8051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0a00/0x631fd8698c780c39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc63a expref: 6 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518066.635891:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2fdc000) 00010000:00010000:1.0:1789518066.635893:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518066.635896:0:8051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e0a00, rc 0) 00000100:00100000:1.0:1789518066.635965:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:5607:x1876445616933888:12345-192.168.206.51@tcp:101: Request processed in 454us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518066.635971:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00010000:00010000:1.0:1789518067.123093:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518067.315700:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789518067.315741:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627438464:0@lo:13: 00000100:00100000:2.0:1789518067.315834:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518067.315909:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627438464 00000100:00100000:3.0:1789518067.315925:0:6652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627438464 00000100:00080000:2.0:1789518067.315984:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518067.316010:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789518067.316024:0:6652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0790000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627438464:12345-0@lo:13: 00002000:00000024:3.0:1789518067.316048:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789518067.316127:0:6652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0790000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627438464:12345-0@lo:13: Request processed in 108us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518067.316134:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789518067.316228:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fff79afb80 x1876445627438464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518083 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518067.316243:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627438464:0@lo:13: 00000001:00100000:3.0:1789518067.347467:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cfa1c47d-1425-4fe5-be2a-28ad5152a12d 00010000:00010000:2.0:1789518068.146754:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518068.379263:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518068.379687:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616934016 00000100:00100000:1.0:1789518068.379696:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616934016 00000100:00100000:1.0:1789518068.379769:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:1.0:1789518068.379779:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:5659:x1876445616934016:12345-192.168.206.51@tcp:41: 00000004:00000024:1.0:1789518068.379823:0:5813:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789518068.379947:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:5659:x1876445616934016:12345-192.168.206.51@tcp:41: Request processed in 114us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518068.379967:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00080000:2.0:1789518068.380039:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518068.384175:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518068.384276:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616934144 00000100:00100000:2.0:1789518068.384285:0:6651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616934144 00000100:00100000:2.0:1789518068.384388:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:2.0:1789518068.384402:0:6651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:5659:x1876445616934144:12345-192.168.206.51@tcp:13: 00002000:00000024:2.0:1789518068.384435:0:6651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789518068.384491:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518068.384496:0:6651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:5659:x1876445616934144:12345-192.168.206.51@tcp:13: Request processed in 99us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518068.384504:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:0.0:1789518068.387313:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518068.387388:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616934272 00000100:00100000:2.0:1789518068.387396:0:6651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616934272 00000100:00080000:0.0:1789518068.387451:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518068.387470:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:2.0:1789518068.387489:0:6651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:5659:x1876445616934272:12345-192.168.206.51@tcp:13: 00002000:00000024:2.0:1789518068.387535:0:6651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789518068.387599:0:6651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:5659:x1876445616934272:12345-192.168.206.51@tcp:13: Request processed in 119us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518068.387607:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00010000:00010000:2.0:1789518069.170773:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789518069.984356:0:8257:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789518070.194749:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518070.386833:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627438976:0@lo:400: 00000100:00100000:3.0:1789518070.386904:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518070.386960:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789518070.386967:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627438848:0@lo:400: 00000100:00100000:3.0:1789518070.387002:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518070.387036:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627438976 00000100:00100000:3.0:1789518070.387043:0:6649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627438976 00000100:00100000:3.0:1789518070.387094:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789518070.387098:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0790a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627439360:0@lo:13: 00000100:00100000:3.0:1789518070.387106:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627438976:12345-0@lo:400: 00000100:00100000:2.0:1789518070.387132:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518070.387162:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627438976:12345-0@lo:400: Request processed in 57us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518070.387169:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789518070.387178:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627439360 00000100:00100000:2.0:1789518070.387183:0:6651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627439360 00000100:00100000:3.0:1789518070.387206:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627438848 00000100:00100000:3.0:1789518070.387211:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627438848 00000100:00100000:2.0:1789518070.387223:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789518070.387232:0:6651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627439360:12345-0@lo:13: 00000100:00100000:3.0:1789518070.387245:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789518070.387255:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627438848:12345-0@lo:400: 00002000:00000024:2.0:1789518070.387259:0:6651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789518070.387293:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627438848:12345-0@lo:400: Request processed in 40us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518070.387300:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789518070.387319:0:6651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627439360:12345-0@lo:13: Request processed in 88us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518070.387338:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789518070.387370:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627438848:0@lo:400: 00010000:00080000:2.0:1789518070.387376:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffd0790a80 x1876445627439360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518086 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518070.387387:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00010000:00080000:3.0:1789518070.387388:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fff79ad180 x1876445627438976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518070.387400:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627438976:0@lo:400: 00000100:00100000:2.0:1789518070.387410:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0790a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627439360:0@lo:13: 00000100:00100000:0.0:1789518070.387558:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:824c8f07-28fa-48fd-81af-173b194570e6:3282:1876445627438592:0@lo:400: 00000100:00100000:0.0:1789518070.387605:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518070.387653:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627439104:0@lo:400: 00000100:00080000:2.0:1789518070.387661:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789518070.387667:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789518070.387671:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518070.387680:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518070.387695:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627438720:0@lo:400: 00000100:00100000:0.0:1789518070.387714:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627439104 00000100:00100000:0.0:1789518070.387720:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627439104 00000100:00100000:2.0:1789518070.387727:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518070.387752:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627439232:0@lo:400: 00000100:00100000:0.0:1789518070.387755:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627438720 00000100:00100000:0.0:1789518070.387759:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627438720 00000100:00100000:0.0:1789518070.387782:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789518070.387793:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876445627439104:12345-0@lo:400: 00000100:00100000:2.0:1789518070.387794:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518070.387830:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789518070.387843:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627438720:12345-0@lo:400: 00000100:00100000:0.0:1789518070.387844:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876445627439104:12345-0@lo:400: Request processed in 51us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518070.387855:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789518070.387885:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627438720:12345-0@lo:400: Request processed in 46us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518070.387890:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627438592 00000100:00100000:2.0:1789518070.387892:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789518070.387896:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627438592 00000100:00100000:2.0:1789518070.387926:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627438720:0@lo:400: 00000100:00100000:0.0:1789518070.387933:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789518070.387942:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc777b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+19:3282:x1876445627438592:12345-0@lo:400: 00000100:00080000:2.0:1789518070.387957:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518070.387982:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc777b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+19:3282:x1876445627438592:12345-0@lo:400: Request processed in 41us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518070.387989:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789518070.388019:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:824c8f07-28fa-48fd-81af-173b194570e6:3282:1876445627438592:0@lo:400: 00000100:00100000:0.0:1789518070.388028:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627439104:0@lo:400: 00000100:00100000:3.0:1789518070.388179:0:6647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627439232 00000100:00100000:3.0:1789518070.388184:0:6647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627439232 00000100:00100000:3.0:1789518070.388217:0:6647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789518070.388224:0:6647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0792680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627439232:12345-0@lo:400: 00000100:00100000:3.0:1789518070.388267:0:6647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0792680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627439232:12345-0@lo:400: Request processed in 44us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518070.388273:0:6647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789518070.388739:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fff79ace00 x1876445627439232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518070.388762:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627439232:0@lo:400: 00000001:00100000:1.0:1789518070.930846:0:7607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cfa1c47d-1425-4fe5-be2a-28ad5152a12d 00010000:00010000:2.0:1789518071.224197:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518071.694134:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518071.694185:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518071.694222:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518071.694245:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518071.694279:0:6647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616934784 00000100:00100000:3.0:1789518071.694291:0:6647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616934784 00000100:00100000:1.0:1789518071.694302:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616934656 00000100:00100000:1.0:1789518071.694315:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616934656 00000100:00100000:3.0:1789518071.694382:0:6647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:3.0:1789518071.694398:0:6647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2343:x1876445616934784:12345-192.168.206.51@tcp:400: 00000100:00100000:0.0:1789518071.694408:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616934528 00000100:00100000:0.0:1789518071.694414:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616934528 00000100:00100000:0.0:1789518071.694474:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:0.0:1789518071.694485:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2343:x1876445616934528:12345-192.168.206.51@tcp:400: 00000100:00100000:0.0:1789518071.694559:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2343:x1876445616934528:12345-192.168.206.51@tcp:400: Request processed in 76us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518071.694567:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:0.0:1789518071.694591:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616934400 00000100:00100000:0.0:1789518071.694595:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616934400 00000100:00100000:0.0:1789518071.694644:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 125 00000100:00100000:0.0:1789518071.694651:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc8101c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+10:2343:x1876445616934400:12345-192.168.206.51@tcp:400: 00000100:00100000:0.0:1789518071.694676:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc8101c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+10:2343:x1876445616934400:12345-192.168.206.51@tcp:400: Request processed in 26us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518071.694682:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 125 00000100:00080000:0.0:1789518071.694841:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789518071.694845:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789518071.694847:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518071.695118:0:6647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2343:x1876445616934784:12345-192.168.206.51@tcp:400: Request processed in 722us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518071.695128:0:6647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:1.0:1789518071.695157:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:1.0:1789518071.695172:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2343:x1876445616934656:12345-192.168.206.51@tcp:400: 00000100:00100000:1.0:1789518071.695215:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2343:x1876445616934656:12345-192.168.206.51@tcp:400: Request processed in 48us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518071.695224:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00000020:00000080:3.0:1789518072.113877:0:8407:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffd2e6af50 20000000:00000080:3.0:1789518072.113892:0:8407:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99ffff55cc00 uarg=0000000000000000 20000000:01000000:3.0:1789518072.113922:0:8407:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1789518072.113924:0:8407:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1789518072.113926:0:8407:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789518072.113931:0:8407:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789518072.113936:0:8407:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1789518072.113948:0:8407:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789518072.113950:0:8407:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789518072.114188:0:8407:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789518072.114191:0:8407:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789518072.115040:0:8408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1789518072.115440:0:8407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1789518072.115489:0:8407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1789518072.115522:0:8407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1789518072.115533:0:8407:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789518072.115535:0:8407:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789518072.116222:0:8409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1789518072.116513:0:8407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1789518072.116567:0:8407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1789518072.116603:0:8407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1789518072.116879:0:8407:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789518072.116881:0:8407:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789518072.117539:0:8410:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1789518072.118022:0:8407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1789518072.118066:0:8407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1789518072.118118:0:8407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1789518072.118132:0:8407:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789518072.118134:0:8407:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789518072.118952:0:8411:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1789518072.119341:0:8407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1789518072.119408:0:8407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1789518072.119457:0:8407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:3.0:1789518072.119472:0:8407:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789518072.119491:0:8407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ffc6b16000/0x631fd8698c780c40 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518072.119509:0:8407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffc6b17a00/0x631fd8698c780b3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780b36 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518072.119518:0:8407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffc0030200/0x631fd8698c780b67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780b60 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518072.119524:0:8407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffc29e0200/0x631fd8698c780b91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780b8a expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518072.119530:0:8407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffc0030000/0x631fd8698c780b9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780b98 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518072.119535:0:8407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780bad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780ba6 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518072.119541:0:8407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99fffc28c200/0x631fd8698c780bc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780bc2 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518072.119548:0:8407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffc6b17c00/0x631fd8698c780bf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780bec expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518072.119557:0:8407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780c01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc5d8 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518072.119565:0:8407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99fffc28c800/0x631fd8698c780c08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc5df expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518072.119583:0:8407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ffc6b16000/0x631fd8698c780c40 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518072.119917:0:8407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99fffc28c800/0x631fd8698c780c08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc5df expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518072.119930:0:8407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99fffc28c800/0x631fd8698c780c08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc5df expref: 9 pid: 5805 timeout: 226 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518072.119940:0:8407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79aca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8407:1876445627439488:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518072.120070:0:8407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780c01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc5d8 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518072.120079:0:8407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780c01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc5d8 expref: 9 pid: 5806 timeout: 226 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518072.120087:0:8407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79af480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8407:1876445627439616:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518072.120121:0:8407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffc6b17c00/0x631fd8698c780bf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c780bec expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518072.120129:0:8407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffc6b17c00/0x631fd8698c780bf3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c780bec expref: 18 pid: 5806 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518072.120136:0:8407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79ac000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8407:1876445627439744:0@lo:104: 00000100:00100000:3.0:1789518072.120176:0:8407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518072.120253:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627439744 00000100:00100000:2.0:1789518072.120260:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627439744 00010000:00010000:3.0:1789518072.120328:0:8407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99fffc28c200/0x631fd8698c780bc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c780bc2 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518072.120348:0:8407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99fffc28c200/0x631fd8698c780bc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c780bc2 expref: 18 pid: 5806 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518072.120356:0:8407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79ace00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8407:1876445627439872:0@lo:104: 00000100:00100000:3.0:1789518072.120381:0:8407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518072.120419:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789518072.120431:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627439872 00000100:00100000:0.0:1789518072.120434:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627439872 00000100:00100000:0.0:1789518072.120455:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1789518072.120467:0:8407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780bad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c780ba6 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518072.120468:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:824c8f07-28fa-48fd-81af-173b194570e6+4:8407:x1876445627439744:12345-0@lo:104: 00010000:00010000:3.0:1789518072.120475:0:8407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780bad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c780ba6 expref: 18 pid: 5807 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518072.120479:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c780bec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780bf3 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518072.120483:0:8407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79ac700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8407:1876445627440000:0@lo:104: 00000100:00100000:3.0:1789518072.120503:0:8407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789518072.120519:0:8407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffc0030000/0x631fd8698c780b9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c780b98 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518072.120527:0:8407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffc0030000/0x631fd8698c780b9f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c780b98 expref: 18 pid: 5805 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518072.120535:0:8407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79af800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8407:1876445627440128:0@lo:104: 00000100:00100000:3.0:1789518072.120569:0:8407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518072.120571:0:5796:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1789518072.120577:0:5796:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:3.0:1789518072.120585:0:8407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffc29e0200/0x631fd8698c780b91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c780b8a expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518072.120593:0:8407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffc29e0200/0x631fd8698c780b91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c780b8a expref: 18 pid: 5807 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518072.120602:0:8407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79aea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8407:1876445627440256:0@lo:104: 00000100:00100000:3.0:1789518072.120655:0:8407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518072.120666:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627440000 00000100:00100000:2.0:1789518072.120670:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627440000 00010000:00010000:3.0:1789518072.120679:0:8407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffc0030200/0x631fd8698c780b67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c780b60 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518072.120684:0:5796:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1789518072.120687:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627440128 00010000:00010000:3.0:1789518072.120688:0:8407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffc0030200/0x631fd8698c780b67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c780b60 expref: 18 pid: 5807 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518072.120689:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627440128 00000100:00100000:3.0:1789518072.120696:0:8407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff664700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8407:1876445627440384:0@lo:104: 00000100:00100000:2.0:1789518072.120697:0:5796:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1789518072.120701:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627440256 00000100:00100000:2.0:1789518072.120703:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627440256 00000100:00100000:3.0:1789518072.120715:0:8407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518072.120730:0:5796:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1789518072.120735:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627440384 00000100:00100000:2.0:1789518072.120737:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627440384 00000100:00100000:2.0:1789518072.120779:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789518072.120785:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b0c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:824c8f07-28fa-48fd-81af-173b194570e6+8:8407:x1876445627439872:12345-0@lo:104: 00010000:00010000:2.0:1789518072.120793:0:8412:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c780bc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780bc9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518072.120909:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789518072.120915:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:824c8f07-28fa-48fd-81af-173b194570e6+8:8407:x1876445627439744:12345-0@lo:104: Request processed in 448us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518072.120922:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789518072.120939:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789518072.120945:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:824c8f07-28fa-48fd-81af-173b194570e6+7:8407:x1876445627440000:12345-0@lo:104: 00010000:00010000:3.0:1789518072.120947:0:8407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffc6b17a00/0x631fd8698c780b3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c780b36 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518072.120952:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0e00/0x631fd8698c780ba6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780bad expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518072.120955:0:8407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffc6b17a00/0x631fd8698c780b3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c780b36 expref: 18 pid: 5807 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518072.120963:0:8407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff665500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8407:1876445627440512:0@lo:104: 00000100:00100000:3.0:1789518072.120983:0:8407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518072.121002:0:8407:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffedb6c240 going to sleep for 11 seconds 00010000:00010000:1.0:1789518072.121013:0:7595:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:3.0:1789518072.121020:0:8407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79ac000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8407:1876445627439744:0@lo:104: 00010000:00010000:1.0:1789518072.121020:0:7595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c780bec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780bf3 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518072.121027:0:8407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79ace00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8407:1876445627439872:0@lo:104: 00010000:00010000:1.0:1789518072.121027:0:7595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28c000 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:1.0:1789518072.121031:0:7595:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c780bec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c780bf3 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518072.121033:0:8407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79ac700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8407:1876445627440000:0@lo:104: 00010000:00010000:1.0:1789518072.121040:0:7595:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c780bec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c780bf3 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518072.121047:0:7595:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c780bec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c780bf3 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518072.121053:0:7595:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789518072.121079:0:7595:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c780bec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780bf3 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.121086:0:7595:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789518072.121111:0:7595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c780bec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780bf3 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.121119:0:7595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c780bec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780bf3 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.121129:0:7595:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789518072.121132:0:7595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c780bc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780bc9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.121138:0:7595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0c00 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:1.0:1789518072.121141:0:7595:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c780bc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c780bc9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.121147:0:7595:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c780bc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c780bc9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518072.121153:0:7595:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c780bc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c780bc9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518072.121158:0:7595:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789518072.121180:0:7595:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c780bc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780bc9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.121186:0:7595:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789518072.121200:0:7595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c780bc2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780bc9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.121206:0:7595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c780bc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780bc9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.121215:0:7595:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518072.121223:0:7595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0e00/0x631fd8698c780ba6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780bad expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.121229:0:7595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0e00 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:1.0:1789518072.121231:0:7595:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0e00/0x631fd8698c780ba6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c780bad expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.121238:0:7595:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0e00/0x631fd8698c780ba6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c780bad expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518072.121244:0:7595:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0e00/0x631fd8698c780ba6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c780bad expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518072.121249:0:7595:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789518072.121263:0:7595:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0e00/0x631fd8698c780ba6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780bad expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.121315:0:7595:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789518072.121331:0:7595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0e00/0x631fd8698c780ba6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780bad expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.121341:0:7595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0e00/0x631fd8698c780ba6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780bad expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.121350:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518072.121352:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518072.121385:0:8412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00010000:00010000:0.0:1789518072.121390:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1789518072.121396:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b0c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:824c8f07-28fa-48fd-81af-173b194570e6+7:8407:x1876445627439872:12345-0@lo:104: Request processed in 611us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518072.121396:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:824c8f07-28fa-48fd-81af-173b194570e6+7:8407:x1876445627440000:12345-0@lo:104: Request processed in 451us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518072.121403:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1789518072.121415:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518072.121415:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627440512 00000100:00100000:0.0:1789518072.121418:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627440512 00000100:00100000:2.0:1789518072.121437:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789518072.121445:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789518072.121451:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:824c8f07-28fa-48fd-81af-173b194570e6+6:8407:x1876445627440128:12345-0@lo:104: 00010000:00010000:0.0:1789518072.121458:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16e00/0x631fd8698c780b98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780b9f expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518072.121473:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789518072.121479:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff665180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:824c8f07-28fa-48fd-81af-173b194570e6+6:8407:x1876445627440256:12345-0@lo:104: 00010000:00010000:2.0:1789518072.121486:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffc0030e00/0x631fd8698c780b8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780b91 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518072.121501:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789518072.121506:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:824c8f07-28fa-48fd-81af-173b194570e6+6:8407:x1876445627440128:12345-0@lo:104: Request processed in 55us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518072.121512:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1789518072.121516:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789518072.121520:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff665180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:824c8f07-28fa-48fd-81af-173b194570e6+6:8407:x1876445627440256:12345-0@lo:104: Request processed in 43us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518072.121525:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789518072.121529:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789518072.121534:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789518072.121535:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff664e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:824c8f07-28fa-48fd-81af-173b194570e6+4:8407:x1876445627440384:12345-0@lo:104: 00000100:00100000:2.0:1789518072.121539:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff666300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:824c8f07-28fa-48fd-81af-173b194570e6+4:8407:x1876445627440512:12345-0@lo:104: 00010000:00010000:0.0:1789518072.121542:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8000/0x631fd8698c780b60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780b67 expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.121544:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1400/0x631fd8698c780b36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780b3d expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.121568:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:0.0:1789518072.121568:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789518072.121573:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff666300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:824c8f07-28fa-48fd-81af-173b194570e6+4:8407:x1876445627440512:12345-0@lo:104: Request processed in 34us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518072.121574:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff664e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:824c8f07-28fa-48fd-81af-173b194570e6+4:8407:x1876445627440384:12345-0@lo:104: Request processed in 38us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518072.121579:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789518072.121582:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1789518072.121592:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789518072.121596:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16e00/0x631fd8698c780b98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780b9f expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.121601:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16e00 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:2.0:1789518072.121604:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16e00/0x631fd8698c780b98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c780b9f expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.121639:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16e00/0x631fd8698c780b98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c780b9f expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518072.121646:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16e00/0x631fd8698c780b98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c780b9f expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518072.121650:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789518072.121660:0:7595:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789518072.121665:0:7595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc0030e00/0x631fd8698c780b8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780b91 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.121668:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16e00/0x631fd8698c780b98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780b9f expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.121671:0:7595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc0030e00 already unused, calling callback (ffffffffc1b17c20) 00010000:00010000:2.0:1789518072.121673:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:1.0:1789518072.121678:0:7595:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc0030e00/0x631fd8698c780b8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c780b91 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.121679:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16e00/0x631fd8698c780b98 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780b9f expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.121685:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16e00/0x631fd8698c780b98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780b9f expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.121686:0:7595:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc0030e00/0x631fd8698c780b8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c780b91 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518072.121692:0:7595:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc0030e00/0x631fd8698c780b8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c780b91 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.121694:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789518072.121697:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1400/0x631fd8698c780b36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780b3d expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518072.121697:0:7595:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789518072.121702:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1400 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:2.0:1789518072.121705:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1400/0x631fd8698c780b36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c780b3d expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.121709:0:7595:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffc0030e00/0x631fd8698c780b8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780b91 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.121712:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1400/0x631fd8698c780b36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c780b3d expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.121715:0:7595:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:2.0:1789518072.121719:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1400/0x631fd8698c780b36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c780b3d expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.121719:0:7595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc0030e00/0x631fd8698c780b8a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780b91 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.121725:0:7595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc0030e00/0x631fd8698c780b8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780b91 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518072.121728:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789518072.121734:0:7595:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518072.121737:0:7595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8000/0x631fd8698c780b60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780b67 expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.121738:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1400/0x631fd8698c780b36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780b3d expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.121743:0:7595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29c8000 already unused, calling callback (ffffffffc1b17c20) 00010000:00010000:2.0:1789518072.121744:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:1.0:1789518072.121746:0:7595:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8000/0x631fd8698c780b60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c780b67 expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.121747:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1400/0x631fd8698c780b36 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780b3d expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.121753:0:7595:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8000/0x631fd8698c780b60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c780b67 expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.121754:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1400/0x631fd8698c780b36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780b3d expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.121763:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518072.121764:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518072.121766:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:1.0:1789518072.121767:0:7595:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8000/0x631fd8698c780b60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c780b67 expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518072.121772:0:7595:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789518072.121789:0:7595:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8000/0x631fd8698c780b60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780b67 expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.121794:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518072.121795:0:7595:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789518072.121799:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518072.121799:0:7595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8000/0x631fd8698c780b60 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780b67 expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.121805:0:7595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc29c8000/0x631fd8698c780b60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780b67 expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518072.121808:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4001180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:824c8f07-28fa-48fd-81af-173b194570e6:3283:1876445627440896:0@lo:103: 00010000:00010000:1.0:1789518072.121817:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518072.121819:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518072.121820:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518072.121829:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4001880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:824c8f07-28fa-48fd-81af-173b194570e6:3281:1876445627440640:0@lo:103: 00000100:00100000:1.0:1789518072.121856:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0790700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:824c8f07-28fa-48fd-81af-173b194570e6:3280:1876445627441024:0@lo:103: 00000100:00100000:3.0:1789518072.121974:0:8407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79af800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8407:1876445627440128:0@lo:104: 00000100:00100000:3.0:1789518072.121983:0:8407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79aea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8407:1876445627440256:0@lo:104: 00000100:00100000:3.0:1789518072.121990:0:8407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff664700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8407:1876445627440384:0@lo:104: 00000100:00100000:3.0:1789518072.121997:0:8407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff665500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8407:1876445627440512:0@lo:104: 00000100:00100000:2.0:1789518072.122027:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518072.122092:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627440896 00000100:00100000:1.0:1789518072.122096:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627440896 00010000:00010000:1.0:1789518072.122115:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780bad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780ba6 expref: 19 pid: 5807 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518072.122136:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789518072.122142:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0791500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:824c8f07-28fa-48fd-81af-173b194570e6+19:3283:x1876445627440896:12345-0@lo:103: 00010000:00010000:1.0:1789518072.122161:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518072.122177:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780bad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780ba6 expref: 19 pid: 5807 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.122191:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780bad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c780ba6 expref: 19 pid: 5807 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.122211:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780bad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c780ba6 expref: 19 pid: 5807 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.122230:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518072.122255:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518072.122283:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627441024 00000100:00100000:3.0:1789518072.122292:0:5798:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627441024 00010000:00010000:3.0:1789518072.122306:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffc0030000/0x631fd8698c780b9f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780b98 expref: 19 pid: 5805 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518072.122312:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518072.122344:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4000e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:824c8f07-28fa-48fd-81af-173b194570e6:3281:1876445627441152:0@lo:103: 00000100:00100000:0.0:1789518072.122368:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518072.122385:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4001500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:824c8f07-28fa-48fd-81af-173b194570e6:3283:1876445627441408:0@lo:103: 00000100:00100000:2.0:1789518072.122413:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4000380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:824c8f07-28fa-48fd-81af-173b194570e6:3282:1876445627440768:0@lo:103: 00000100:00100000:1.0:1789518072.122474:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0791500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:824c8f07-28fa-48fd-81af-173b194570e6+19:3283:x1876445627440896:12345-0@lo:103: Request processed in 332us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518072.122482:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789518072.122561:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627440640 00000100:00100000:1.0:1789518072.122565:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627440640 00010000:00010000:1.0:1789518072.122576:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffc6b17c00/0x631fd8698c780bf3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780bec expref: 19 pid: 5806 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518072.122586:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627441152 00000100:00100000:1.0:1789518072.122588:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627441152 00000100:00100000:3.0:1789518072.122591:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1789518072.122596:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffc29e0200/0x631fd8698c780b91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780b8a expref: 20 pid: 5807 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518072.122597:0:5798:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6502d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:824c8f07-28fa-48fd-81af-173b194570e6+20:3280:x1876445627441024:12345-0@lo:103: 00010000:00010000:3.0:1789518072.122605:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789518072.122607:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1789518072.122609:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffc0030000/0x631fd8698c780b9f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780b98 expref: 20 pid: 5805 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518072.122631:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6501f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:824c8f07-28fa-48fd-81af-173b194570e6+20:3281:x1876445627440640:12345-0@lo:103: 00010000:00010000:3.0:1789518072.122637:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffc0030000/0x631fd8698c780b9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c780b98 expref: 20 pid: 5805 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.122638:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518072.122642:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffc6b17c00/0x631fd8698c780bf3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780bec expref: 20 pid: 5806 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518072.122648:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc0030000/0x631fd8698c780b9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c780b98 expref: 20 pid: 5805 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.122649:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffc6b17c00/0x631fd8698c780bf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c780bec expref: 20 pid: 5806 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518072.122664:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518072.122668:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b17c00/0x631fd8698c780bf3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c780bec expref: 19 pid: 5806 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.122676:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518072.122691:0:5798:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6502d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:824c8f07-28fa-48fd-81af-173b194570e6+18:3280:x1876445627441024:12345-0@lo:103: Request processed in 94us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518072.122696:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6501f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:824c8f07-28fa-48fd-81af-173b194570e6+18:3281:x1876445627440640:12345-0@lo:103: Request processed in 85us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518072.122698:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789518072.122701:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789518072.122710:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789518072.122715:0:5798:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6502300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:824c8f07-28fa-48fd-81af-173b194570e6+16:3281:x1876445627441152:12345-0@lo:103: 00010000:00010000:3.0:1789518072.122722:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518072.122727:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffc29e0200/0x631fd8698c780b91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780b8a expref: 16 pid: 5807 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518072.122735:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffc29e0200/0x631fd8698c780b91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c780b8a expref: 16 pid: 5807 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518072.122744:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc29e0200/0x631fd8698c780b91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c780b8a expref: 16 pid: 5807 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518072.122757:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518072.122777:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518072.122779:0:5798:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6502300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:824c8f07-28fa-48fd-81af-173b194570e6+15:3281:x1876445627441152:12345-0@lo:103: Request processed in 64us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518072.122797:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0790e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:824c8f07-28fa-48fd-81af-173b194570e6:3282:1876445627441280:0@lo:103: 00000100:00100000:2.0:1789518072.122830:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627440768 00000100:00100000:0.0:1789518072.122830:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518072.122833:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627440768 00010000:00010000:2.0:1789518072.122847:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99fffc28c200/0x631fd8698c780bc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780bc2 expref: 16 pid: 5806 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518072.122859:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0790700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:824c8f07-28fa-48fd-81af-173b194570e6:3280:1876445627441024:0@lo:103: 00000100:00100000:0.0:1789518072.122882:0:7597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627441280 00000100:00100000:0.0:1789518072.122886:0:7597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627441280 00010000:00010000:0.0:1789518072.122899:0:7597:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffc6b17a00/0x631fd8698c780b3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780b36 expref: 17 pid: 5807 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518072.122942:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518072.122965:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4001180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:824c8f07-28fa-48fd-81af-173b194570e6:3283:1876445627440896:0@lo:103: 00000100:00100000:1.0:1789518072.122980:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627441408 00000100:00100000:1.0:1789518072.122983:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627441408 00010000:00010000:1.0:1789518072.122993:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffc0030200/0x631fd8698c780b67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780b60 expref: 18 pid: 5807 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518072.123005:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789518072.123011:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd8065c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:824c8f07-28fa-48fd-81af-173b194570e6+18:3283:x1876445627441408:12345-0@lo:103: 00010000:00010000:1.0:1789518072.123018:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518072.123022:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffc0030200/0x631fd8698c780b67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780b60 expref: 18 pid: 5807 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.123029:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffc0030200/0x631fd8698c780b67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c780b60 expref: 18 pid: 5807 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.123037:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc0030200/0x631fd8698c780b67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c780b60 expref: 18 pid: 5807 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.123045:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518072.123070:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd8065c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:824c8f07-28fa-48fd-81af-173b194570e6+17:3283:x1876445627441408:12345-0@lo:103: Request processed in 59us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518072.123082:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789518072.123107:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4001500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:824c8f07-28fa-48fd-81af-173b194570e6:3283:1876445627441408:0@lo:103: 00000100:00100000:3.0:1789518072.123162:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789518072.123885:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4001880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:824c8f07-28fa-48fd-81af-173b194570e6:3281:1876445627440640:0@lo:103: 00000100:00100000:3.0:1789518072.123894:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4000e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:824c8f07-28fa-48fd-81af-173b194570e6:3281:1876445627441152:0@lo:103: 00000100:00100000:2.0:1789518072.124189:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789518072.124200:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6502a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:824c8f07-28fa-48fd-81af-173b194570e6+15:3282:x1876445627440768:12345-0@lo:103: 00010000:00010000:2.0:1789518072.124224:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518072.124231:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99fffc28c200/0x631fd8698c780bc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780bc2 expref: 15 pid: 5806 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.124242:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99fffc28c200/0x631fd8698c780bc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c780bc2 expref: 15 pid: 5806 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.124253:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc28c200/0x631fd8698c780bc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c780bc2 expref: 15 pid: 5806 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.124264:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518072.124301:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6502a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:824c8f07-28fa-48fd-81af-173b194570e6+14:3282:x1876445627440768:12345-0@lo:103: Request processed in 105us (1523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518072.124307:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789518072.124395:0:8407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79aca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8407:1876445627439488:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518072.124406:0:8407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79af480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8407:1876445627439616:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518072.124441:0:8407:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ffc6b16000/0x631fd8698c780c40 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518072.125553:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4000380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:824c8f07-28fa-48fd-81af-173b194570e6:3282:1876445627440768:0@lo:103: 00000100:00100000:0.0:1789518072.125787:0:7597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789518072.125799:0:7597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:824c8f07-28fa-48fd-81af-173b194570e6+13:3282:x1876445627441280:12345-0@lo:103: 00010000:00010000:0.0:1789518072.125812:0:7597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518072.125820:0:7597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffc6b17a00/0x631fd8698c780b3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780b36 expref: 13 pid: 5807 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518072.125846:0:7597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffc6b17a00/0x631fd8698c780b3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c780b36 expref: 13 pid: 5807 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518072.125858:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b17a00/0x631fd8698c780b3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c780b36 expref: 13 pid: 5807 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518072.125869:0:7597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518072.125919:0:7597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:824c8f07-28fa-48fd-81af-173b194570e6+12:3282:x1876445627441280:12345-0@lo:103: Request processed in 124us (3088us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518072.125926:0:7597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789518072.125974:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0790e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:824c8f07-28fa-48fd-81af-173b194570e6:3282:1876445627441280:0@lo:103: 00000100:00100000:1.0:1789518072.126348:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518072.126381:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518072.126483:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518072.126535:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616934912 00000100:00100000:3.0:1789518072.126541:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616934912 00010000:00010000:3.0:1789518072.126564:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99fffc28c800/0x631fd8698c780c08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc5df expref: 10 pid: 5805 timeout: 226 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518072.126595:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616935040 00000100:00100000:3.0:1789518072.126599:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616935040 00010000:00010000:3.0:1789518072.126644:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780c01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc5d8 expref: 11 pid: 5806 timeout: 226 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518072.126665:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:3.0:1789518072.126671:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4001500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e55716f-fc49-42ce-abad-050985078c82+11:2342:x1876445616934912:12345-192.168.206.51@tcp:103: 00010000:00010000:3.0:1789518072.126680:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518072.126684:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99fffc28c800/0x631fd8698c780c08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc5df expref: 11 pid: 5805 timeout: 226 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518072.126700:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99fffc28c800/0x631fd8698c780c08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc5df expref: 11 pid: 5805 timeout: 226 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518072.126718:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc28c800/0x631fd8698c780c08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc5df expref: 11 pid: 5805 timeout: 226 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518072.126739:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616935168 00000100:00100000:0.0:1789518072.126743:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616935168 00000100:00100000:0.0:1789518072.126767:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 126 00000100:00100000:0.0:1789518072.126775:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc8103450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+12:5579:x1876445616935168:12345-192.168.206.51@tcp:101: 00010000:00010000:0.0:1789518072.126786:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518072.126787:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518072.126797:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc28d600/0x631fd8698c780c47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc641 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518072.126811:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffc6b16000/0x631fd8698c780c40 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518072.126820:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99fffc28d600/0x631fd8698c780c47 lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc641 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518072.126835:0:5806:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: ffff99ffc6b16000/0x631fd8698c780c40 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518072.126858:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc28d600/0x631fd8698c780c47 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc641 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518072.126865:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28d600, rc 0) 00000100:00100000:3.0:1789518072.126892:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4001500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e55716f-fc49-42ce-abad-050985078c82+12:2342:x1876445616934912:12345-192.168.206.51@tcp:103: Request processed in 220us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518072.126900:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:3.0:1789518072.126904:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:2.0:1789518072.126908:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4001180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e55716f-fc49-42ce-abad-050985078c82+12:2342:x1876445616935040:12345-192.168.206.51@tcp:103: 00010000:00010000:2.0:1789518072.126915:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518072.126920:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780c01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc5d8 expref: 11 pid: 5806 timeout: 226 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.126928:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780c01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc5d8 expref: 11 pid: 5806 timeout: 226 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.126939:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780c01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc5d8 expref: 11 pid: 5806 timeout: 226 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.126949:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ffc6b16000/0x631fd8698c780c40 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.126962:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc6b16000/0x631fd8698c780c40 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.126975:0:5799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffc6b16000/0x631fd8698c780c40 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.126982:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffc6b16000/0x631fd8698c780c40 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.126990:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ffc6b16000/0x631fd8698c780c40 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.126997:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ffc6b16000/0x631fd8698c780c40 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.127003:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518072.127006:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ffc6b16000/0x631fd8698c780c40 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.127013:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ffc6b16000/0x631fd8698c780c40 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518072.127098:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc8103450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+10:5579:x1876445616935168:12345-192.168.206.51@tcp:101: Request processed in 323us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518072.127105:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 126 00010000:00010000:3.0:1789518072.127418:0:8407:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ffc6b16000/0x631fd8698c780c40 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518072.127428:0:8407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ffc6b16000/0x631fd8698c780c40 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.127681:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99fffc28d600/0x631fd8698c780c47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc641 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.127689:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc28d600/0x631fd8698c780c47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc641 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.127715:0:5799:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: ffff99fffc28d600/0x631fd8698c780c47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc641 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518072.127736:0:5799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0792d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:MGS:5799:1876445627441536:192.168.206.51@tcp:105: 00000100:00100000:2.0:1789518072.127792:0:5799:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc9247300 going to sleep for 11 seconds 00000100:00100000:2.0:1789518072.132794:0:5799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0792d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:MGS:5799:1876445627441536:192.168.206.51@tcp:105: 00010000:00010000:2.0:1789518072.132821:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ffc6b16000/0x631fd8698c780c40 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.132834:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b16000/0x631fd8698c780c40 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.132846:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518072.132903:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4001180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e55716f-fc49-42ce-abad-050985078c82+9:2342:x1876445616935040:12345-192.168.206.51@tcp:103: Request processed in 5994us (6519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518072.132912:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:3.0:1789518072.132981:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518072.133059:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616935296 00000100:00100000:2.0:1789518072.133066:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616935296 00000100:00100000:2.0:1789518072.133107:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 127 00000100:00100000:2.0:1789518072.133115:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc8103050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+9:5579:x1876445616935296:12345-192.168.206.51@tcp:501: 00000100:00100000:2.0:1789518072.133360:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc8103050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+9:5579:x1876445616935296:12345-192.168.206.51@tcp:501: Request processed in 244us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518072.133368:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 127 00000100:00100000:3.0:1789518072.143151:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518072.143256:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616935424 00000100:00100000:0.0:1789518072.143265:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616935424 00000100:00100000:0.0:1789518072.143335:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 128 00000100:00100000:0.0:1789518072.143357:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7646450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+9:5579:x1876445616935424:12345-192.168.206.51@tcp:503: 00000100:00100000:0.0:1789518072.143546:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7646450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+9:5579:x1876445616935424:12345-192.168.206.51@tcp:503: Request processed in 191us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518072.143554:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 128 00000100:00100000:3.0:1789518072.146976:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518072.147026:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616935552 00000100:00100000:1.0:1789518072.147039:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616935552 00000100:00100000:1.0:1789518072.147086:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 129 00000100:00100000:1.0:1789518072.147095:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7645450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+9:6039:x1876445616935552:12345-192.168.206.51@tcp:502: 00000100:00100000:1.0:1789518072.147569:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7645450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+9:6039:x1876445616935552:12345-192.168.206.51@tcp:502: Request processed in 472us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518072.147578:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 129 00000100:00100000:1.0:1789518072.149899:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518072.149965:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616935680 00000100:00100000:0.0:1789518072.149973:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616935680 00000100:00100000:0.0:1789518072.150018:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 130 00000100:00100000:0.0:1789518072.150028:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7644c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+9:6039:x1876445616935680:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789518072.150243:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7644c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+9:6039:x1876445616935680:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 216us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518072.150250:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 130 00000100:00100000:3.0:1789518072.155824:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518072.157022:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616935808 00000100:00100000:0.0:1789518072.157033:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616935808 00000100:00100000:0.0:1789518072.157086:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 131 00000100:00100000:0.0:1789518072.157096:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7644050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+9:5579:x1876445616935808:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518072.157115:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518072.157130:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc28ca00/0x631fd8698c780c4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc648 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518072.157155:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc28ca00/0x631fd8698c780c4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc648 expref: 10 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518072.157165:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc28ca00/0x631fd8698c780c4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc648 expref: 10 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518072.157174:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28ca00, rc 0) 00000100:00100000:0.0:1789518072.157222:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7644050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+10:5579:x1876445616935808:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 129us (1405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518072.157229:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 131 00000100:00100000:3.0:1789518072.159076:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518072.159142:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616935936 00000100:00100000:0.0:1789518072.159148:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616935936 00000100:00100000:0.0:1789518072.160123:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 132 00000100:00100000:0.0:1789518072.160133:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7644450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+10:5579:x1876445616935936:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518072.160364:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7644450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+10:5579:x1876445616935936:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 231us (1293us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789518072.160372:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 132 00010000:00010000:2.0:1789518072.243079:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518072.434986:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789518072.435018:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff664380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627441664:0@lo:13: 00000100:00100000:3.0:1789518072.435075:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518072.435139:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627441664 00000100:00100000:3.0:1789518072.435146:0:6652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627441664 00000100:00100000:3.0:1789518072.435194:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789518072.435202:0:6652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627441664:12345-0@lo:13: 00002000:00000024:3.0:1789518072.435233:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789518072.435274:0:6652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627441664:12345-0@lo:13: Request processed in 72us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518072.435281:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789518072.435349:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffff664380 x1876445627441664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518088 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518072.435373:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff664380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627441664:0@lo:13: 00000100:00080000:0.0:1789518072.435479:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1789518072.719410:0:8461:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff60e0ccf0 20000000:00000080:2.0:1789518072.719426:0:8461:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99fff4b0c400 uarg=0000000000000000 20000000:01000000:2.0:1789518072.719460:0:8461:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789518072.719465:0:8461:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789518072.719469:0:8461:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789518072.720474:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1789518072.720790:0:8461:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1789518072.725108:0:8461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1789518072.725162:0:8461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1789518072.725913:0:8461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1789518072.725934:0:8461:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789518072.725953:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780c55 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.725971:0:8461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffc0031a00/0x631fd8698c780a2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780a25 expref: 11 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.725978:0:8461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a00021c6c00/0x631fd8698c780a8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780a87 expref: 11 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.725985:0:8461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffc0031800/0x631fd8698c780b59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780b52 expref: 11 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.725995:0:8461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99fffc28d000/0x631fd8698c780c16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc610 expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.726002:0:8461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780c55 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.726040:0:8461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99fffc28d000/0x631fd8698c780c16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc610 expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.726053:0:8461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99fffc28d000/0x631fd8698c780c16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc610 expref: 9 pid: 5807 timeout: 226 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518072.726066:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0792d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1876445627441792:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518072.726171:0:8461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffc0031800/0x631fd8698c780b59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c780b52 expref: 11 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.726189:0:8461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffc0031800/0x631fd8698c780b59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c780b52 expref: 11 pid: 5805 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518072.726213:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0790e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1876445627441920:0@lo:104: 00000100:00100000:2.0:1789518072.726253:0:8461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789518072.726297:0:8461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a00021c6c00/0x631fd8698c780a8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c780a87 expref: 11 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.726306:0:8461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a00021c6c00/0x631fd8698c780a8e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c780a87 expref: 11 pid: 5805 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518072.726322:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0790700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1876445627442048:0@lo:104: 00000100:00100000:2.0:1789518072.726346:0:8461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789518072.726368:0:8461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffc0031a00/0x631fd8698c780a2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c780a25 expref: 11 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.726378:0:8461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffc0031a00/0x631fd8698c780a2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c780a25 expref: 11 pid: 5807 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518072.726387:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1876445627442176:0@lo:104: 00000100:00100000:2.0:1789518072.726406:0:8461:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd07806c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518072.726542:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789518072.726562:0:5795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518072.726584:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627441920 00000100:00100000:0.0:1789518072.726590:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627441920 00000100:00100000:0.0:1789518072.726647:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627442048 00000100:00100000:0.0:1789518072.726651:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627442048 00000100:00100000:0.0:1789518072.726663:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627442176 00000100:00100000:0.0:1789518072.726666:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627442176 00000100:00100000:0.0:1789518072.726679:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789518072.726688:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0791500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:824c8f07-28fa-48fd-81af-173b194570e6+5:8461:x1876445627441920:12345-0@lo:104: 00010000:00010000:0.0:1789518072.726700:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0600/0x631fd8698c780b52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780b59 expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518072.726752:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789518072.726758:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0791500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:824c8f07-28fa-48fd-81af-173b194570e6+5:8461:x1876445627441920:12345-0@lo:104: Request processed in 72us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518072.726764:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789518072.726779:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789518072.726785:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff6db450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:824c8f07-28fa-48fd-81af-173b194570e6+4:8461:x1876445627442048:12345-0@lo:104: 00010000:00010000:0.0:1789518072.726793:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9800/0x631fd8698c780a87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780a8e expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518072.726814:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789518072.726827:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:824c8f07-28fa-48fd-81af-173b194570e6+4:8461:x1876445627442176:12345-0@lo:104: 00010000:00010000:0.0:1789518072.726836:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1789518072.726837:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1800/0x631fd8698c780a25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780a2c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518072.726846:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff6db450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:824c8f07-28fa-48fd-81af-173b194570e6+4:8461:x1876445627442048:12345-0@lo:104: Request processed in 60us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518072.726854:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1789518072.726892:0:7596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789518072.726898:0:7596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0600/0x631fd8698c780b52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780b59 expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518072.726907:0:7596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0600 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:0.0:1789518072.726911:0:7596:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0600/0x631fd8698c780b52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c780b59 expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518072.726930:0:7596:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0600/0x631fd8698c780b52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c780b59 expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518072.726937:0:7596:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0600/0x631fd8698c780b52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c780b59 expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518072.726943:0:7596:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789518072.726970:0:7596:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0600/0x631fd8698c780b52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780b59 expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518072.726977:0:7596:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518072.726993:0:7596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0600/0x631fd8698c780b52 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780b59 expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518072.727000:0:7596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0600/0x631fd8698c780b52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780b59 expref: -99 pid: 7589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518072.727013:0:7596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518072.727016:0:7596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9800/0x631fd8698c780a87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780a8e expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518072.727022:0:7596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29c9800 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:0.0:1789518072.727025:0:7596:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9800/0x631fd8698c780a87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c780a8e expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518072.727031:0:7596:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9800/0x631fd8698c780a87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c780a8e expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518072.727038:0:7596:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9800/0x631fd8698c780a87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c780a8e expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518072.727050:0:7596:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789518072.727067:0:7596:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9800/0x631fd8698c780a87 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780a8e expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518072.727074:0:7596:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518072.727084:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789518072.727093:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:824c8f07-28fa-48fd-81af-173b194570e6+3:8461:x1876445627442176:12345-0@lo:104: Request processed in 270us (529us total) trans 0 rc 0/0 00010000:00010000:0.0:1789518072.727094:0:7596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9800/0x631fd8698c780a87 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780a8e expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.727102:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789518072.727107:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1789518072.727110:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1800/0x631fd8698c780a25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780a2c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518072.727114:0:7596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9800/0x631fd8698c780a87 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780a8e expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.727123:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1800 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:1.0:1789518072.727128:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1800/0x631fd8698c780a25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c780a2c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518072.727134:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518072.727137:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518072.727140:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518072.727146:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:824c8f07-28fa-48fd-81af-173b194570e6:3282:1876445627442432:0@lo:103: 00010000:00010000:1.0:1789518072.727149:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1800/0x631fd8698c780a25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c780a2c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518072.727155:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1800/0x631fd8698c780a25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c780a2c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518072.727161:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789518072.727163:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518072.727175:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789518072.727183:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1800/0x631fd8698c780a25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780a2c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.727189:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789518072.727196:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1800/0x631fd8698c780a25 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780a2c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.727203:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1800/0x631fd8698c780a25 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780a2c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.727217:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518072.727219:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518072.727220:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518072.727240:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789518072.727249:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:824c8f07-28fa-48fd-81af-173b194570e6:3280:1876445627442304:0@lo:103: 00000100:00100000:2.0:1789518072.727303:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0790e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1876445627441920:0@lo:104: 00000100:00100000:2.0:1789518072.727312:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0790700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1876445627442048:0@lo:104: 00000100:00100000:2.0:1789518072.727329:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1876445627442176:0@lo:104: 00000100:00100000:0.0:1789518072.727385:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627442432 00000100:00100000:0.0:1789518072.727390:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627442432 00010000:00010000:0.0:1789518072.727409:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a00021c6c00/0x631fd8698c780a8e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780a87 expref: 12 pid: 5805 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518072.727440:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789518072.727447:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff664380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:824c8f07-28fa-48fd-81af-173b194570e6+12:3282:x1876445627442432:12345-0@lo:103: 00010000:00010000:0.0:1789518072.727458:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518072.727463:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a00021c6c00/0x631fd8698c780a8e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780a87 expref: 12 pid: 5805 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518072.727472:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a00021c6c00/0x631fd8698c780a8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c780a87 expref: 12 pid: 5805 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518072.727495:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789518072.727497:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a00021c6c00/0x631fd8698c780a8e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c780a87 expref: 12 pid: 5805 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518072.727510:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518072.727544:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff664380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:824c8f07-28fa-48fd-81af-173b194570e6+11:3282:x1876445627442432:12345-0@lo:103: Request processed in 98us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518072.727553:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4002300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:824c8f07-28fa-48fd-81af-173b194570e6:3283:1876445627442560:0@lo:103: 00000100:00100000:0.0:1789518072.727553:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789518072.727569:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627442304 00000100:00100000:0.0:1789518072.727574:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627442304 00010000:00010000:0.0:1789518072.727588:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffc0031800/0x631fd8698c780b59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780b52 expref: 11 pid: 5805 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518072.727590:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518072.727636:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627442560 00000100:00100000:0.0:1789518072.727640:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627442560 00010000:00010000:0.0:1789518072.727653:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffc0031a00/0x631fd8698c780a2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780a25 expref: 12 pid: 5807 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518072.727669:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789518072.727686:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789518072.727694:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4003100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:824c8f07-28fa-48fd-81af-173b194570e6+12:3283:x1876445627442560:12345-0@lo:103: 00010000:00010000:0.0:1789518072.727702:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518072.727707:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffc0031a00/0x631fd8698c780a2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780a25 expref: 12 pid: 5807 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518072.727718:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffc0031a00/0x631fd8698c780a2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c780a25 expref: 12 pid: 5807 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518072.727731:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc0031a00/0x631fd8698c780a2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c780a25 expref: 12 pid: 5807 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518072.727752:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518072.727797:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4003100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:824c8f07-28fa-48fd-81af-173b194570e6+11:3283:x1876445627442560:12345-0@lo:103: Request processed in 104us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518072.727805:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789518072.727814:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:824c8f07-28fa-48fd-81af-173b194570e6:3282:1876445627442432:0@lo:103: 00000100:00100000:2.0:1789518072.727938:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4002300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:824c8f07-28fa-48fd-81af-173b194570e6:3283:1876445627442560:0@lo:103: 00000100:00100000:1.0:1789518072.727978:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4000700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:824c8f07-28fa-48fd-81af-173b194570e6+10:3280:x1876445627442304:12345-0@lo:103: 00010000:00010000:1.0:1789518072.727987:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518072.727997:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffc0031800/0x631fd8698c780b59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780b52 expref: 10 pid: 5805 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.728005:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffc0031800/0x631fd8698c780b59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c780b52 expref: 10 pid: 5805 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.728015:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc0031800/0x631fd8698c780b59 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c780b52 expref: 10 pid: 5805 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518072.728024:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518072.728068:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4000700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:824c8f07-28fa-48fd-81af-173b194570e6+9:3280:x1876445627442304:12345-0@lo:103: Request processed in 390us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518072.728074:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789518072.728152:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:824c8f07-28fa-48fd-81af-173b194570e6:3280:1876445627442304:0@lo:103: 00000100:00100000:2.0:1789518072.728503:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0792d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1876445627441792:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518072.728533:0:8461:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780c55 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518072.729373:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518072.729409:0:7597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616936064 00000100:00100000:2.0:1789518072.729415:0:7597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616936064 00010000:00010000:2.0:1789518072.729436:0:7597:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99fffc28d000/0x631fd8698c780c16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc610 expref: 10 pid: 5807 timeout: 226 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518072.729463:0:7597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:2.0:1789518072.729470:0:7597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff667480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e55716f-fc49-42ce-abad-050985078c82+10:2343:x1876445616936064:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518072.729480:0:7597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518072.729485:0:7597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99fffc28d000/0x631fd8698c780c16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc610 expref: 10 pid: 5807 timeout: 226 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.729494:0:7597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99fffc28d000/0x631fd8698c780c16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc610 expref: 10 pid: 5807 timeout: 226 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.729505:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc28d000/0x631fd8698c780c16 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc610 expref: 10 pid: 5807 timeout: 226 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.729517:0:7597:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780c55 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.729525:0:7597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780c55 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.729537:0:7597:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780c55 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.729543:0:7597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780c55 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.729556:0:7597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780c55 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.729562:0:7597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780c55 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.729567:0:7597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29c8800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518072.729570:0:7597:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780c55 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.729577:0:7597:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780c55 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.729603:0:7597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780c55 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518072.729638:0:7597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518072.729678:0:7597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff667480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e55716f-fc49-42ce-abad-050985078c82+9:2343:x1876445616936064:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 209us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518072.729685:0:7597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 24 00010000:00010000:0.0:1789518072.729751:0:8461:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780c55 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518072.729759:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780c55 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518072.729765:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780c55 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518073.266928:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518074.000887:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518074.001608:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616936192 00000100:00100000:3.0:1789518074.001636:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616936192 00000100:00100000:3.0:1789518074.001694:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 133 00000100:00100000:3.0:1789518074.002316:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7647850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+9:5579:x1876445616936192:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518074.002333:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518074.002351:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc6b16800/0x631fd8698c780c5c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc64f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518074.002375:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc6b16800/0x631fd8698c780c5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc64f expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518074.002386:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc6b16800/0x631fd8698c780c5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc64f expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518074.002400:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16800, rc 0) 00000100:00100000:3.0:1789518074.002495:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7647850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+10:5579:x1876445616936192:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 232us (1614us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518074.002502:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 133 00000100:00100000:1.0:1789518074.005082:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518074.005175:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616936320 00000100:00100000:0.0:1789518074.005184:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616936320 00000100:00100000:0.0:1789518074.005235:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 134 00000100:00100000:0.0:1789518074.005247:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7645850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+10:5579:x1876445616936320:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518074.005589:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7645850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+10:5579:x1876445616936320:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 342us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518074.005598:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 134 00000100:00100000:0.0:1789518074.014786:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518074.014874:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616936448 00000100:00100000:1.0:1789518074.014884:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616936448 00000100:00100000:1.0:1789518074.014931:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 135 00000100:00100000:1.0:1789518074.014941:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7645050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+10:5579:x1876445616936448:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518074.015127:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7645050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+10:5579:x1876445616936448:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 187us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518074.015135:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 135 00000100:00100000:1.0:1789518074.018055:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518074.018383:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616936576 00000100:00100000:3.0:1789518074.018392:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616936576 00000100:00100000:3.0:1789518074.018449:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 136 00000100:00100000:3.0:1789518074.018459:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7646850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+10:6111:x1876445616936576:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789518074.018761:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7646850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+10:6111:x1876445616936576:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 301us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518074.018770:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 136 00000100:00100000:2.0:1789518074.023514:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518074.023651:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616936704 00000100:00100000:1.0:1789518074.023661:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616936704 00000100:00100000:1.0:1789518074.023713:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 137 00000100:00100000:1.0:1789518074.023722:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7646c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+10:6111:x1876445616936704:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789518074.023953:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7646c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+10:6111:x1876445616936704:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 231us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518074.023967:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 137 10000000:01000000:1.0:1789518074.099072:0:5810:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789518074.099079:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99ffff791800 from 39 10000000:01000000:1.0:1789518074.099084:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789518074.099125:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1400/0x631fd8698c780c63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518074.099135:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1400/0x631fd8698c780c63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518074.099152:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1400/0x631fd8698c780c63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518074.099174:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4003800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627442688:0@lo:101: 00000100:00100000:1.0:1789518074.099233:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518074.099336:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627442688 00000100:00100000:3.0:1789518074.099344:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627442688 00000100:00100000:1.0:1789518074.099377:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0d64600 going to sleep for 11 seconds 00000100:00100000:3.0:1789518074.100758:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789518074.100773:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7647450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+9:5810:x1876445627442688:12345-0@lo:101: 00010000:00010000:3.0:1789518074.100787:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518074.100800:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc6b17600/0x631fd8698c780c6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780c63 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518074.100823:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc6b17600/0x631fd8698c780c6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780c63 expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518074.100833:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc6b17600/0x631fd8698c780c6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780c63 expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518074.100841:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17600, rc 0) 00000100:00100000:3.0:1789518074.100971:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7647450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+10:5810:x1876445627442688:12345-0@lo:101: Request processed in 203us (1737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518074.100978:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789518074.101727:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4003800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627442688:0@lo:101: 00010000:00010000:1.0:1789518074.101745:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1400/0x631fd8698c780c63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780c6a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518074.101755:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1400/0x631fd8698c780c63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780c6a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518074.101816:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4003800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627442816:0@lo:501: 00000100:00100000:1.0:1789518074.101851:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518074.101885:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0d64600 going to sleep for 11 seconds 00000100:00100000:0.0:1789518074.101899:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627442816 00000100:00100000:0.0:1789518074.101907:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627442816 00000100:00100000:0.0:1789518074.101951:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789518074.101960:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7647050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+10:5810:x1876445627442816:12345-0@lo:501: 00000100:00100000:0.0:1789518074.102406:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7647050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+10:5810:x1876445627442816:12345-0@lo:501: Request processed in 447us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518074.102414:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789518074.102500:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4003800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627442816:0@lo:501: 00000100:00100000:1.0:1789518074.102538:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4003800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627442944:0@lo:503: 00000100:00100000:1.0:1789518074.102577:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518074.102599:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0d64600 going to sleep for 11 seconds 00000100:00100000:0.0:1789518074.102667:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627442944 00000100:00100000:0.0:1789518074.102672:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627442944 00000100:00100000:0.0:1789518074.102709:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789518074.102717:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7647c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+10:5810:x1876445627442944:12345-0@lo:503: 00000100:00100000:0.0:1789518074.102860:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7647c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+10:5810:x1876445627442944:12345-0@lo:503: Request processed in 144us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518074.102867:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789518074.102945:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4003800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627442944:0@lo:503: 00000100:00100000:1.0:1789518074.105070:0:8570:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4003800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8570:1876445627443072:0@lo:502: 00000100:00100000:1.0:1789518074.105132:0:8570:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518074.105211:0:8570:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0d64000 going to sleep for 11 seconds 00000100:00100000:0.0:1789518074.105253:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627443072 00000100:00100000:0.0:1789518074.105259:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627443072 00000100:00100000:0.0:1789518074.105298:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789518074.105318:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+10:8570:x1876445627443072:12345-0@lo:502: 00000100:00100000:0.0:1789518074.105703:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+10:8570:x1876445627443072:12345-0@lo:502: Request processed in 396us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518074.105711:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789518074.105825:0:8570:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4003800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8570:1876445627443072:0@lo:502: 00000100:00100000:1.0:1789518074.105863:0:8570:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4003800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8570:1876445627443200:0@lo:502: 00000100:00100000:1.0:1789518074.105894:0:8570:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518074.105955:0:8570:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0d64000 going to sleep for 11 seconds 00000100:00100000:0.0:1789518074.105988:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627443200 00000100:00100000:0.0:1789518074.105992:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627443200 00000100:00100000:0.0:1789518074.106024:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789518074.106030:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+10:8570:x1876445627443200:12345-0@lo:502: 00000100:00100000:0.0:1789518074.106197:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+10:8570:x1876445627443200:12345-0@lo:502: Request processed in 166us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518074.106204:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789518074.106257:0:8570:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4003800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8570:1876445627443200:0@lo:502: 00000040:00080000:1.0:1789518074.106275:0:8570:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789518074.106449:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789518074.106528:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789518074.106537:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1400/0x631fd8698c780c63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780c6a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518074.106548:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1400/0x631fd8698c780c63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780c6a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518074.106567:0:5810:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789518074.106570:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1789518074.106572:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789518074.106592:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9a00/0x631fd8698c780c71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518074.106600:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9a00/0x631fd8698c780c71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518074.106609:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9a00/0x631fd8698c780c71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518074.106844:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627443328:0@lo:101: 00000100:00100000:2.0:1789518074.106872:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518074.106932:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0780300 going to sleep for 11 seconds 00000100:00100000:0.0:1789518074.106967:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627443328 00000100:00100000:0.0:1789518074.106972:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627443328 00000100:00100000:0.0:1789518074.107032:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789518074.107045:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+10:5810:x1876445627443328:12345-0@lo:101: 00010000:00010000:0.0:1789518074.107054:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518074.107065:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc28c400/0x631fd8698c780c78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780c71 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518074.107084:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc28c400/0x631fd8698c780c78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780c71 expref: 11 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518074.107093:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc28c400/0x631fd8698c780c78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780c71 expref: 11 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518074.107100:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28c400, rc 0) 00000100:00100000:0.0:1789518074.107137:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+11:5810:x1876445627443328:12345-0@lo:101: Request processed in 93us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518074.107143:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789518074.107199:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627443328:0@lo:101: 00010000:00010000:2.0:1789518074.107211:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9a00/0x631fd8698c780c71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780c78 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518074.107219:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9a00/0x631fd8698c780c71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780c78 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518074.107257:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627443456:0@lo:501: 00000100:00100000:2.0:1789518074.107279:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518074.107436:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0780300 going to sleep for 11 seconds 00000100:00100000:3.0:1789518074.107475:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627443456 00000100:00100000:3.0:1789518074.107480:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627443456 00000100:00100000:0.0:1789518074.107512:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789518074.107518:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+11:5810:x1876445627443456:12345-0@lo:501: 00000100:00100000:0.0:1789518074.107745:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+11:5810:x1876445627443456:12345-0@lo:501: Request processed in 226us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518074.107752:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789518074.107810:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627443456:0@lo:501: 00000100:00100000:2.0:1789518074.107834:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627443584:0@lo:503: 00000100:00100000:2.0:1789518074.107869:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518074.108121:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0780300 going to sleep for 11 seconds 00000100:00100000:1.0:1789518074.108155:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627443584 00000100:00100000:1.0:1789518074.108159:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627443584 00000100:00100000:1.0:1789518074.108178:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789518074.108185:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+11:5810:x1876445627443584:12345-0@lo:503: 00000100:00100000:1.0:1789518074.108325:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+11:5810:x1876445627443584:12345-0@lo:503: Request processed in 140us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518074.108332:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789518074.108402:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627443584:0@lo:503: 00000100:00100000:2.0:1789518074.108800:0:8571:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8571:1876445627443712:0@lo:502: 00000100:00100000:2.0:1789518074.108835:0:8571:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518074.108955:0:8571:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0780e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789518074.109032:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627443712 00000100:00100000:3.0:1789518074.109037:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627443712 00000100:00100000:3.0:1789518074.109059:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789518074.109065:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+11:8571:x1876445627443712:12345-0@lo:502: 00000100:00100000:3.0:1789518074.109260:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+11:8571:x1876445627443712:12345-0@lo:502: Request processed in 194us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518074.109268:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789518074.109390:0:8571:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8571:1876445627443712:0@lo:502: 00000020:01000000:2.0:1789518074.109411:0:8571:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789518074.109419:0:8571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518074.109421:0:8571:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789518074.109427:0:8571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789518074.109446:0:8571:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8571:1876445627443840:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789518074.109549:0:8571:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518074.109609:0:8571:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0780e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789518074.109812:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627443840 00000100:00100000:3.0:1789518074.109817:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627443840 00000100:00100000:3.0:1789518074.109885:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789518074.109892:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+11:8571:x1876445627443840:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518074.110020:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+11:8571:x1876445627443840:12345-0@lo:502:llog_process_th.0 Request processed in 129us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518074.110027:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789518074.110089:0:8571:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8571:1876445627443840:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789518074.110106:0:8571:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789518074.110110:0:8571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518074.110112:0:8571:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789518074.110115:0:8571:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1789518074.110248:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1789518074.110263:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789518074.110272:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9a00/0x631fd8698c780c71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780c78 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518074.110294:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9a00/0x631fd8698c780c71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780c78 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518074.110303:0:5810:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789518074.110306:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ffff791800 from 4 10000000:01000000:1.0:1789518074.110319:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789518074.110341:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0200/0x631fd8698c780c7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518074.110349:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0200/0x631fd8698c780c7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518074.110358:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0200/0x631fd8698c780c7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518074.110371:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4003800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627443968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789518074.110396:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518074.110533:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0d64840 going to sleep for 11 seconds 00000100:00100000:0.0:1789518074.110560:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627443968 00000100:00100000:0.0:1789518074.110564:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627443968 00000100:00100000:2.0:1789518074.110659:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789518074.110668:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+11:5810:x1876445627443968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789518074.110677:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518074.110773:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc29c9400/0x631fd8698c780c86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780c7f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518074.110794:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc29c9400/0x631fd8698c780c86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780c7f expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518074.110809:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc29c9400/0x631fd8698c780c86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780c7f expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518074.110817:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29c9400, rc 0) 00000100:00100000:2.0:1789518074.110853:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+12:5810:x1876445627443968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518074.110859:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789518074.110914:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4003800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627443968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518074.110925:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0200/0x631fd8698c780c7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780c86 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518074.110934:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0200/0x631fd8698c780c7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780c86 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518074.110972:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4003800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627444096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518074.110997:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518074.111030:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0d64840 going to sleep for 11 seconds 00000100:00100000:3.0:1789518074.111087:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627444096 00000100:00100000:3.0:1789518074.111091:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627444096 00000100:00100000:3.0:1789518074.111110:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789518074.111115:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+12:5810:x1876445627444096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518074.111419:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+12:5810:x1876445627444096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 302us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518074.111425:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789518074.111526:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4003800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627444096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518074.111552:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4003800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627444224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518074.111591:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518074.111649:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0d64840 going to sleep for 11 seconds 00000100:00100000:3.0:1789518074.111725:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627444224 00000100:00100000:3.0:1789518074.111736:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627444224 00000100:00100000:3.0:1789518074.111766:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789518074.111773:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+12:5810:x1876445627444224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789518074.111901:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+12:5810:x1876445627444224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518074.111907:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789518074.111993:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4003800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627444224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789518074.112298:0:8572:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8572:1876445627444352:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789518074.112349:0:8572:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518074.112376:0:8572:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0780f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518074.112404:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627444352 00000100:00100000:0.0:1789518074.112410:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627444352 00000100:00100000:0.0:1789518074.112449:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789518074.112456:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+12:8572:x1876445627444352:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518074.112608:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+12:8572:x1876445627444352:12345-0@lo:502:llog_process_th.0 Request processed in 152us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518074.112641:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789518074.112649:0:8572:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8572:1876445627444352:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789518074.112670:0:8572:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518074.112679:0:8572:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518074.112681:0:8572:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789518074.112699:0:8572:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ffff791800 00000020:00000080:3.0:1789518074.112702:0:8572:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789518074.112766:0:8572:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff664000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8572:1876445627444480:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518074.112810:0:8572:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518074.112839:0:8572:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff406e840 going to sleep for 11 seconds 00000100:00100000:0.0:1789518074.112951:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627444480 00000100:00100000:0.0:1789518074.112956:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627444480 00000100:00100000:0.0:1789518074.112987:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789518074.112994:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+12:8572:x1876445627444480:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518074.113124:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+12:8572:x1876445627444480:12345-0@lo:502:llog_process_th.0 Request processed in 129us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518074.113131:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789518074.113158:0:8572:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff664000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8572:1876445627444480:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789518074.113179:0:8572:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518074.113184:0:8572:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518074.113185:0:8572:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789518074.113190:0:8572:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789518074.113284:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789518074.113303:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789518074.113320:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0200/0x631fd8698c780c7f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780c86 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518074.113331:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0200/0x631fd8698c780c7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780c86 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518074.113340:0:5810:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789518074.113343:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99ffc76f3000 from 39 10000000:01000000:0.0:1789518074.113345:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789518074.113369:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc28cc00/0x631fd8698c780c8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518074.113377:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fffc28cc00/0x631fd8698c780c8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518074.113385:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fffc28cc00/0x631fd8698c780c8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518074.113399:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627444608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789518074.113438:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518074.113458:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc4f159c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518074.113566:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627444608 00000100:00100000:1.0:1789518074.113571:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627444608 00000100:00100000:1.0:1789518074.113606:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789518074.113744:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+12:5810:x1876445627444608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518074.113754:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518074.113766:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc29e0e00/0x631fd8698c780c94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780c8d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518074.113785:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc29e0e00/0x631fd8698c780c94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780c8d expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518074.113795:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc29e0e00/0x631fd8698c780c94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780c8d expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518074.113804:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e0e00, rc 0) 00000100:00100000:1.0:1789518074.113891:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+13:5810:x1876445627444608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 277us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518074.113898:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789518074.113946:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627444608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518074.113958:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fffc28cc00/0x631fd8698c780c8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780c94 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518074.113966:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fffc28cc00/0x631fd8698c780c8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780c94 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518074.114008:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627444736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518074.114036:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518074.114061:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc4f159c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518074.114341:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627444736 00000100:00100000:3.0:1789518074.114346:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627444736 00000100:00100000:3.0:1789518074.114380:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789518074.114386:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+13:5810:x1876445627444736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518074.114581:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+13:5810:x1876445627444736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 194us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518074.114589:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789518074.114675:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627444736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518074.114704:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4003800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627444864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518074.114747:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518074.114776:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc9113240 going to sleep for 11 seconds 00000100:00100000:3.0:1789518074.114821:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627444864 00000100:00100000:3.0:1789518074.114825:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627444864 00000100:00100000:3.0:1789518074.114857:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789518074.114864:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+13:5810:x1876445627444864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789518074.115007:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+13:5810:x1876445627444864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518074.115014:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789518074.115360:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4003800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627444864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518074.115933:0:8574:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda6bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8574:1876445627444992:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518074.115975:0:8574:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518074.116002:0:8574:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc4f15cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518074.116038:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627444992 00000100:00100000:1.0:1789518074.116042:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627444992 00000100:00100000:1.0:1789518074.116069:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789518074.116074:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+13:8574:x1876445627444992:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518074.116300:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+13:8574:x1876445627444992:12345-0@lo:502:llog_process_th.0 Request processed in 225us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518074.116305:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789518074.116353:0:8574:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda6bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8574:1876445627444992:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518074.116398:0:8574:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda6bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8574:1876445627445120:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518074.116433:0:8574:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518074.116456:0:8574:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc4f15cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518074.116472:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627445120 00000100:00100000:1.0:1789518074.116476:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627445120 00000100:00100000:1.0:1789518074.116549:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789518074.116557:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+13:8574:x1876445627445120:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518074.116735:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+13:8574:x1876445627445120:12345-0@lo:502:llog_process_th.0 Request processed in 178us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518074.116742:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789518074.116853:0:8574:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda6bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8574:1876445627445120:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789518074.116871:0:8574:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789518074.117819:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1789518074.117840:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789518074.117850:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc28cc00/0x631fd8698c780c8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780c94 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518074.117860:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fffc28cc00/0x631fd8698c780c8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780c94 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518074.117869:0:5810:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789518074.117872:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1789518074.117875:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789518074.117902:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c780c9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518074.117917:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c780c9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518074.117926:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c780c9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518074.117944:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4001f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627445248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789518074.117989:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518074.118017:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0d64600 going to sleep for 11 seconds 00000100:00100000:0.0:1789518074.118043:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627445248 00000100:00100000:0.0:1789518074.118050:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627445248 00000100:00100000:0.0:1789518074.118088:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789518074.118105:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+13:5810:x1876445627445248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518074.118115:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518074.118126:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc28c800/0x631fd8698c780ca2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780c9b expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518074.118147:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc28c800/0x631fd8698c780ca2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780c9b expref: 14 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518074.118159:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc28c800/0x631fd8698c780ca2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780c9b expref: 14 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518074.118167:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28c800, rc 0) 00000100:00100000:0.0:1789518074.118320:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+14:5810:x1876445627445248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 217us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518074.118327:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789518074.118336:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4001f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627445248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518074.118349:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c780c9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780ca2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518074.118358:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c780c9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780ca2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518074.118401:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4001f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627445376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518074.118425:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518074.118489:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0d64600 going to sleep for 11 seconds 00000100:00100000:0.0:1789518074.118522:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627445376 00000100:00100000:0.0:1789518074.118526:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627445376 00000100:00100000:0.0:1789518074.118586:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789518074.118593:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+14:5810:x1876445627445376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518074.118818:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+14:5810:x1876445627445376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 225us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518074.118825:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789518074.118889:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4001f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627445376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518074.118913:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4001f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627445504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518074.118948:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518074.118969:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0d64600 going to sleep for 11 seconds 00000100:00100000:1.0:1789518074.118979:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627445504 00000100:00100000:1.0:1789518074.118982:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627445504 00000100:00100000:1.0:1789518074.119009:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789518074.119015:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+14:5810:x1876445627445504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518074.119276:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+14:5810:x1876445627445504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 260us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518074.119283:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789518074.119402:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4001f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627445504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518074.119930:0:8576:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4002680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8576:1876445627445632:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518074.119963:0:8576:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518074.120027:0:8576:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff4047b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789518074.120060:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627445632 00000100:00100000:0.0:1789518074.120064:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627445632 00000100:00100000:0.0:1789518074.120177:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789518074.120185:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+14:8576:x1876445627445632:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518074.120412:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+14:8576:x1876445627445632:12345-0@lo:502:llog_process_th.0 Request processed in 227us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518074.120419:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789518074.120485:0:8576:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4002680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8576:1876445627445632:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789518074.120505:0:8576:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518074.120513:0:8576:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518074.120515:0:8576:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789518074.120522:0:8576:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789518074.120539:0:8576:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff664000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8576:1876445627445760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518074.120569:0:8576:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518074.120661:0:8576:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff406e240 going to sleep for 11 seconds 00000100:00100000:1.0:1789518074.120704:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627445760 00000100:00100000:1.0:1789518074.120708:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627445760 00000100:00100000:1.0:1789518074.120728:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789518074.120734:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+14:8576:x1876445627445760:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518074.120857:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+14:8576:x1876445627445760:12345-0@lo:502:llog_process_th.0 Request processed in 122us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518074.120864:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789518074.120936:0:8576:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff664000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8576:1876445627445760:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789518074.120958:0:8576:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518074.120962:0:8576:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518074.120964:0:8576:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789518074.120968:0:8576:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1789518074.121109:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1789518074.121124:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789518074.121132:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c780c9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780ca2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518074.121141:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c780c9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780ca2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518074.121151:0:5810:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789518074.121153:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ffc76f3000 from 4 10000000:01000000:1.0:1789518074.121156:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789518074.121176:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1800/0x631fd8698c780ca9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518074.121193:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1800/0x631fd8698c780ca9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518074.121202:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1800/0x631fd8698c780ca9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518074.121215:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4002680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627445888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789518074.121242:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518074.121286:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff4047780 going to sleep for 11 seconds 00000100:00100000:3.0:1789518074.121423:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627445888 00000100:00100000:3.0:1789518074.121427:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627445888 00000100:00100000:3.0:1789518074.121455:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789518074.121461:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+14:5810:x1876445627445888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518074.121468:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518074.121480:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc6b17800/0x631fd8698c780cb0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780ca9 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518074.121511:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc6b17800/0x631fd8698c780cb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780ca9 expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518074.121521:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc6b17800/0x631fd8698c780cb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780ca9 expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518074.121529:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17800, rc 0) 00000100:00100000:3.0:1789518074.121557:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+15:5810:x1876445627445888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518074.121563:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789518074.121806:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4002680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627445888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518074.121818:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1800/0x631fd8698c780ca9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780cb0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518074.121826:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1800/0x631fd8698c780ca9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780cb0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518074.121864:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4002680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627446016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518074.121891:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518074.121921:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff4047780 going to sleep for 11 seconds 00000100:00100000:3.0:1789518074.121967:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627446016 00000100:00100000:3.0:1789518074.121971:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627446016 00000100:00100000:3.0:1789518074.121997:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789518074.122003:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+15:5810:x1876445627446016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518074.122227:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+15:5810:x1876445627446016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 224us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518074.122234:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789518074.123068:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4002680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627446016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518074.123118:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4002680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627446144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518074.123159:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518074.123190:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff4047780 going to sleep for 11 seconds 00000100:00100000:3.0:1789518074.123289:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627446144 00000100:00100000:3.0:1789518074.123294:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627446144 00000100:00100000:3.0:1789518074.123336:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789518074.123343:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+15:5810:x1876445627446144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789518074.123494:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+15:5810:x1876445627446144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518074.123500:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789518074.123640:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4002680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627446144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518074.124015:0:8577:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4002680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8577:1876445627446272:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518074.124062:0:8577:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518074.124089:0:8577:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff4047180 going to sleep for 11 seconds 00000100:00100000:3.0:1789518074.124174:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627446272 00000100:00100000:3.0:1789518074.124178:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627446272 00000100:00100000:3.0:1789518074.124210:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789518074.124217:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+15:8577:x1876445627446272:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518074.124411:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+15:8577:x1876445627446272:12345-0@lo:502:llog_process_th.0 Request processed in 194us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518074.124418:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789518074.124514:0:8577:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4002680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8577:1876445627446272:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789518074.124537:0:8577:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789518074.124545:0:8577:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518074.124548:0:8577:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789518074.124554:0:8577:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ffc76f3000 00000020:00000080:1.0:1789518074.124557:0:8577:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789518074.124654:0:8577:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4002680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8577:1876445627446400:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518074.124688:0:8577:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518074.124701:0:8577:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0d64600 going to sleep for 11 seconds 00000100:00100000:3.0:1789518074.125082:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627446400 00000100:00100000:3.0:1789518074.125086:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627446400 00000100:00100000:3.0:1789518074.125182:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789518074.125189:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+15:8577:x1876445627446400:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518074.125578:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+15:8577:x1876445627446400:12345-0@lo:502:llog_process_th.0 Request processed in 387us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518074.125586:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789518074.125814:0:8577:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4002680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8577:1876445627446400:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789518074.125838:0:8577:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518074.125843:0:8577:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518074.125846:0:8577:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789518074.125849:0:8577:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789518074.126883:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789518074.126903:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789518074.126912:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1800/0x631fd8698c780ca9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780cb0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518074.126923:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1800/0x631fd8698c780ca9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780cb0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518074.126933:0:5810:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789518074.126935:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99ffc84db000 from 39 10000000:01000000:3.0:1789518074.126938:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789518074.126967:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16a00/0x631fd8698c780cb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518074.126974:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16a00/0x631fd8698c780cb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518074.126997:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16a00/0x631fd8698c780cb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518074.127016:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff664000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627446528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789518074.127059:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518074.127197:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff406ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1789518074.127424:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627446528 00000100:00100000:1.0:1789518074.127431:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627446528 00000100:00100000:1.0:1789518074.127495:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789518074.127505:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+15:5810:x1876445627446528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518074.127515:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518074.127527:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc29e0600/0x631fd8698c780cbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780cb7 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518074.127548:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc29e0600/0x631fd8698c780cbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780cb7 expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518074.127558:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc29e0600/0x631fd8698c780cbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780cb7 expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518074.127573:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e0600, rc 0) 00000100:00100000:1.0:1789518074.127647:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+16:5810:x1876445627446528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518074.127654:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789518074.127721:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff664000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627446528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518074.127733:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16a00/0x631fd8698c780cb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780cbe expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518074.127741:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16a00/0x631fd8698c780cb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780cbe expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518074.127788:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda6bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627446656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518074.127814:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518074.127965:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc4f15180 going to sleep for 11 seconds 00000100:00100000:3.0:1789518074.128002:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627446656 00000100:00100000:3.0:1789518074.128007:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627446656 00000100:00100000:3.0:1789518074.128028:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789518074.128035:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+16:5810:x1876445627446656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518074.128285:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+16:5810:x1876445627446656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518074.128293:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789518074.128499:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda6bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627446656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518074.128528:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda6bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627446784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518074.128563:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518074.128642:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc4f15180 going to sleep for 11 seconds 00000100:00100000:3.0:1789518074.128758:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627446784 00000100:00100000:3.0:1789518074.128763:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627446784 00000100:00100000:3.0:1789518074.128830:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789518074.128837:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+16:5810:x1876445627446784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789518074.128987:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+16:5810:x1876445627446784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518074.128994:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789518074.129059:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda6bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627446784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518074.129236:0:8578:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda6bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8578:1876445627446912:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518074.129286:0:8578:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518074.129544:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627446912 00000100:00100000:1.0:1789518074.129549:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627446912 00000100:00100000:1.0:1789518074.129571:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789518074.129579:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+16:8578:x1876445627446912:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518074.129781:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+16:8578:x1876445627446912:12345-0@lo:502:llog_process_th.0 Request processed in 203us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518074.129789:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789518074.131726:0:8578:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc4f15240 going to sleep for 11 seconds 00000100:00100000:0.0:1789518074.131755:0:8578:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda6bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8578:1876445627446912:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518074.131815:0:8578:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda6bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8578:1876445627447040:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518074.131879:0:8578:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518074.131906:0:8578:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc4f15240 going to sleep for 11 seconds 00000100:00100000:1.0:1789518074.132174:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627447040 00000100:00100000:1.0:1789518074.132180:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627447040 00000100:00100000:1.0:1789518074.132216:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789518074.132224:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+16:8578:x1876445627447040:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518074.132462:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+16:8578:x1876445627447040:12345-0@lo:502:llog_process_th.0 Request processed in 239us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518074.132470:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789518074.133194:0:8578:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda6bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8578:1876445627447040:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789518074.133218:0:8578:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789518074.133489:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1789518074.133508:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789518074.133517:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16a00/0x631fd8698c780cb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780cbe expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518074.133527:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16a00/0x631fd8698c780cb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780cbe expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518074.133547:0:5810:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789518074.133549:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1789518074.133552:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789518074.133575:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1e00/0x631fd8698c780cc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518074.133581:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1e00/0x631fd8698c780cc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518074.133589:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1e00/0x631fd8698c780cc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518074.134546:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4002680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627447168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789518074.134595:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518074.134693:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff4047780 going to sleep for 11 seconds 00000100:00100000:0.0:1789518074.134738:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627447168 00000100:00100000:0.0:1789518074.134744:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627447168 00000100:00100000:0.0:1789518074.134788:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789518074.134798:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc777b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+16:5810:x1876445627447168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518074.134810:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518074.134823:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc28d800/0x631fd8698c780ccc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780cc5 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518074.134845:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc28d800/0x631fd8698c780ccc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780cc5 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518074.134857:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc28d800/0x631fd8698c780ccc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780cc5 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518074.134865:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28d800, rc 0) 00000100:00100000:0.0:1789518074.134953:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc777b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+17:5810:x1876445627447168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518074.134960:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789518074.135014:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4002680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627447168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518074.135027:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1e00/0x631fd8698c780cc5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780ccc expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518074.135036:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1e00/0x631fd8698c780cc5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780ccc expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518074.135080:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4002680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627447296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518074.135168:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518074.135218:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff4047780 going to sleep for 11 seconds 00000100:00100000:0.0:1789518074.135254:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627447296 00000100:00100000:0.0:1789518074.135348:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627447296 00000100:00100000:0.0:1789518074.135414:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789518074.135421:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc777bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+17:5810:x1876445627447296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518074.135661:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc777bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+17:5810:x1876445627447296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 240us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518074.135676:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789518074.135726:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4002680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627447296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518074.135757:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff665880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627447424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789518074.135799:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518074.135827:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627447424 00000100:00100000:0.0:1789518074.135832:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627447424 00000100:00100000:0.0:1789518074.135898:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789518074.135906:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc777a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+17:5810:x1876445627447424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518074.136052:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc777a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+17:5810:x1876445627447424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518074.136060:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789518074.136092:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff406e300 going to sleep for 11 seconds 00000100:00100000:3.0:1789518074.136114:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff665880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627447424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518074.136739:0:8580:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4001f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8580:1876445627447552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518074.136781:0:8580:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518074.136850:0:8580:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff4047780 going to sleep for 11 seconds 00000100:00100000:0.0:1789518074.136937:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627447552 00000100:00100000:0.0:1789518074.136942:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627447552 00000100:00100000:0.0:1789518074.137536:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789518074.137546:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7779c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+17:8580:x1876445627447552:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518074.137904:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7779c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+17:8580:x1876445627447552:12345-0@lo:502:llog_process_th.0 Request processed in 359us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518074.137911:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789518074.137988:0:8580:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4001f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8580:1876445627447552:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789518074.138017:0:8580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518074.138026:0:8580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518074.138028:0:8580:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789518074.138034:0:8580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789518074.138056:0:8580:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff665880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8580:1876445627447680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518074.138106:0:8580:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518074.138284:0:8580:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff406e300 going to sleep for 11 seconds 00000100:00100000:1.0:1789518074.138420:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627447680 00000100:00100000:1.0:1789518074.138426:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627447680 00000100:00100000:1.0:1789518074.138452:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789518074.138459:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+17:8580:x1876445627447680:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518074.138592:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+17:8580:x1876445627447680:12345-0@lo:502:llog_process_th.0 Request processed in 133us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518074.138599:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789518074.138754:0:8580:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff665880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8580:1876445627447680:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789518074.138774:0:8580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518074.138779:0:8580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518074.138780:0:8580:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789518074.138785:0:8580:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1789518074.138922:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1789518074.138937:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789518074.138945:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1e00/0x631fd8698c780cc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780ccc expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518074.138955:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1e00/0x631fd8698c780cc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780ccc expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518074.138965:0:5810:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789518074.138968:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ffc84db000 from 4 10000000:01000000:1.0:1789518074.138971:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789518074.138992:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1000/0x631fd8698c780cd3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518074.139000:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1000/0x631fd8698c780cd3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518074.139009:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1000/0x631fd8698c780cd3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518074.139023:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4003800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627447808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789518074.139051:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518074.139079:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc67cb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518074.139090:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627447808 00000100:00100000:1.0:1789518074.139093:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627447808 00000100:00100000:1.0:1789518074.139181:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789518074.139187:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc777a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+17:5810:x1876445627447808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518074.139194:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518074.139204:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc29e0000/0x631fd8698c780cda lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780cd3 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518074.139221:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc29e0000/0x631fd8698c780cda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780cd3 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518074.139231:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc29e0000/0x631fd8698c780cda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780cd3 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518074.139239:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e0000, rc 0) 00000100:00100000:1.0:1789518074.139367:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc777a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+18:5810:x1876445627447808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518074.139373:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789518074.139404:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4003800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627447808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518074.139417:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1000/0x631fd8698c780cd3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780cda expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518074.139425:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1000/0x631fd8698c780cd3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780cda expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518074.139463:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4003800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627447936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518074.139487:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518074.139507:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc67cb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518074.139519:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627447936 00000100:00100000:1.0:1789518074.139523:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627447936 00000100:00100000:1.0:1789518074.139540:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789518074.139546:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7779450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+18:5810:x1876445627447936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518074.139753:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7779450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+18:5810:x1876445627447936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 206us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518074.139759:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789518074.139788:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4003800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627447936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518074.139812:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4003800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627448064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518074.139845:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518074.139858:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc67cb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518074.139869:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627448064 00000100:00100000:1.0:1789518074.139873:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627448064 00000100:00100000:1.0:1789518074.139890:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789518074.139895:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7778c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+18:5810:x1876445627448064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518074.140010:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7778c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+18:5810:x1876445627448064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518074.140016:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789518074.140047:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4003800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627448064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518074.140834:0:8581:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda6bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8581:1876445627448192:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518074.140872:0:8581:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518074.140937:0:8581:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc9113240 going to sleep for 11 seconds 00000100:00100000:1.0:1789518074.140964:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627448192 00000100:00100000:1.0:1789518074.140968:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627448192 00000100:00100000:1.0:1789518074.141019:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789518074.141026:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7778050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+18:8581:x1876445627448192:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518074.141151:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7778050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+18:8581:x1876445627448192:12345-0@lo:502:llog_process_th.0 Request processed in 125us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518074.141164:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789518074.141352:0:8581:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda6bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8581:1876445627448192:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789518074.141375:0:8581:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518074.141383:0:8581:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518074.141386:0:8581:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789518074.141393:0:8581:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ffc84db000 00000020:00000080:0.0:1789518074.141395:0:8581:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789518074.141497:0:8581:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda6bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8581:1876445627448320:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518074.141532:0:8581:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518074.141550:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627448320 00000100:00100000:0.0:1789518074.141553:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627448320 00000100:00100000:0.0:1789518074.141572:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789518074.141578:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7778450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+18:8581:x1876445627448320:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518074.141691:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7778450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+18:8581:x1876445627448320:12345-0@lo:502:llog_process_th.0 Request processed in 113us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518074.141698:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789518074.141724:0:8581:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd80a0840 going to sleep for 11 seconds 00000100:00100000:0.0:1789518074.141734:0:8581:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda6bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:8581:1876445627448320:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789518074.141750:0:8581:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518074.141754:0:8581:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518074.141756:0:8581:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789518074.141759:0:8581:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789518074.141872:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789518074.141889:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789518074.141897:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1000/0x631fd8698c780cd3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780cda expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518074.141906:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1000/0x631fd8698c780cd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780cda expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518074.141915:0:5810:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789518074.141917:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99ffc64a4d40 from 1 10000000:01000000:1.0:1789518074.141920:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789518074.141938:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1600/0x631fd8698c780ce1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518074.141946:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1600/0x631fd8698c780ce1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518074.141954:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1600/0x631fd8698c780ce1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518074.141965:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4003800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627448448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789518074.141989:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518074.142009:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc67cb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518074.142050:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627448448 00000100:00100000:0.0:1789518074.142054:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627448448 00000100:00100000:0.0:1789518074.142081:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789518074.142087:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc777b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+18:5810:x1876445627448448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518074.142191:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518074.142202:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc28c000/0x631fd8698c780ce8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780ce1 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518074.142219:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc28c000/0x631fd8698c780ce8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780ce1 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518074.142227:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc28c000/0x631fd8698c780ce8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780ce1 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518074.142244:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28c000, rc 0) 00000100:00100000:0.0:1789518074.142432:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc777b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+19:5810:x1876445627448448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 344us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518074.142438:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789518074.142502:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4003800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627448448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518074.142515:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1600/0x631fd8698c780ce1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780ce8 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518074.142524:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1600/0x631fd8698c780ce1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780ce8 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518074.142565:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4003800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627448576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518074.142590:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518074.142640:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc67cb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518074.142702:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627448576 00000100:00100000:0.0:1789518074.142706:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627448576 00000100:00100000:0.0:1789518074.142726:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789518074.142732:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+19:5810:x1876445627448576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518074.142896:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+19:5810:x1876445627448576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 164us (305us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789518074.142902:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789518074.142969:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4003800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627448576:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1789518074.142987:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789518074.142993:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1600/0x631fd8698c780ce1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780ce8 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518074.143000:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1600/0x631fd8698c780ce1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780ce8 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518074.291227:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518075.315602:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518075.506853:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876445627448832:0@lo:400:kworker.0 00000100:00100000:3.0:1789518075.506912:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518075.506971:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627449344:0@lo:400:kworker.0 00000100:00100000:3.0:1789518075.506997:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518075.507028:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789518075.507034:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff665880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:824c8f07-28fa-48fd-81af-173b194570e6:3281:1876445627448704:0@lo:400:kworker.0 00000100:00100000:3.0:1789518075.507062:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518075.507081:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627449216:0@lo:400:kworker.0 00000100:00100000:3.0:1789518075.507104:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518075.507145:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627448960:0@lo:400:kworker.0 00000100:00100000:3.0:1789518075.507169:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518075.507197:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789518075.507203:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627449088:0@lo:400:kworker.0 00000100:00100000:3.0:1789518075.507224:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518075.507262:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627448832 00000100:00100000:3.0:1789518075.507270:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627448832 00000100:00100000:3.0:1789518075.507351:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627449216 00000100:00100000:3.0:1789518075.507355:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627449216 00000100:00100000:0.0:1789518075.507414:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627448704 00000100:00100000:0.0:1789518075.507418:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627448704 00000100:00100000:0.0:1789518075.507454:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789518075.507465:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7779050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+19:3281:x1876445627448704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518075.507517:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7779050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+19:3281:x1876445627448704:12345-0@lo:400:kworker.0 Request processed in 53us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518075.507524:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789518075.507553:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627448960 00000100:00100000:0.0:1789518075.507556:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627448960 00000100:00100000:3.0:1789518075.508238:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789518075.508245:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876445627448832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518075.508282:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876445627448832:12345-0@lo:400:kworker.0 Request processed in 37us (1370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518075.508288:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789518075.508316:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789518075.508323:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627449216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518075.508350:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627449216:12345-0@lo:400:kworker.0 Request processed in 27us (1245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518075.508356:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789518075.508376:0:6647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627449344 00000100:00100000:3.0:1789518075.508380:0:6647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627449344 00000100:00100000:0.0:1789518075.508520:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789518075.508529:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627448960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518075.508568:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627448960:12345-0@lo:400:kworker.0 Request processed in 40us (1397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518075.508586:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1789518075.508635:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789518075.508639:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518075.508664:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff665880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:824c8f07-28fa-48fd-81af-173b194570e6:3281:1876445627448704:0@lo:400:kworker.0 00000100:00100000:0.0:1789518075.508676:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627449216:0@lo:400:kworker.0 00000100:00100000:0.0:1789518075.508684:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876445627448832:0@lo:400:kworker.0 00000100:00100000:1.0:1789518075.508753:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627449088 00000100:00100000:1.0:1789518075.508758:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627449088 00000100:00100000:1.0:1789518075.508792:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789518075.508800:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff665180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627449088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518075.508836:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff665180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627449088:12345-0@lo:400:kworker.0 Request processed in 37us (1610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518075.508843:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789518075.508872:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627449472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518075.508900:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789518075.508938:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffff667b80 x1876445627449088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518075.508960:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627449088:0@lo:400:kworker.0 00000100:00100000:1.0:1789518075.508974:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627448960:0@lo:400:kworker.0 00000100:00100000:1.0:1789518075.509016:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627449472 00000100:00100000:1.0:1789518075.509020:0:6652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627449472 00000100:00100000:1.0:1789518075.509050:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789518075.509057:0:6652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4003800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627449472:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789518075.509199:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518075.510547:0:6647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789518075.510559:0:6647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627449344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518075.510629:0:6647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627449344:12345-0@lo:400:kworker.0 Request processed in 73us (3631us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518075.510635:0:6647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1789518075.510677:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffff666680 x1876445627449344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518075.510688:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627449344:0@lo:400:kworker.0 00002000:00000024:1.0:1789518075.511261:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789518075.511319:0:6652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4003800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627449472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2261us (2417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518075.511327:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1789518075.511509:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffd846c700 x1876445627449472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518091 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518075.511527:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627449472:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789518076.339359:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789518076.540044:0:8765:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:2.0:1789518076.815212:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518076.815257:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518076.815285:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616936832 00000100:00100000:1.0:1789518076.815308:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616936832 00000100:00100000:1.0:1789518076.815359:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 186 00000100:00100000:1.0:1789518076.815375:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc777a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+10:2343:x1876445616936832:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518076.815441:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc777a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+10:2343:x1876445616936832:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 68us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518076.815449:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 186 00000100:00100000:2.0:1789518076.815563:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518076.815595:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518076.815643:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616937216 00000100:00100000:1.0:1789518076.815649:0:6649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616937216 00000100:00100000:2.0:1789518076.815656:0:6647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616937088 00000100:00100000:2.0:1789518076.815663:0:6647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616937088 00000100:00100000:1.0:1789518076.815691:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:1.0:1789518076.815700:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2342:x1876445616937216:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518076.815702:0:6647:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789518076.815714:0:6647:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:2.0:1789518076.815734:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789518076.815738:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518076.815744:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2342:x1876445616937216:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 44us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518076.815751:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:1.0:1789518076.815765:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:1.0:1789518076.815772:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2343:x1876445616937088:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518076.815810:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2343:x1876445616937088:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 39us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518076.815816:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:0.0:1789518076.816084:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616936960 00000100:00100000:0.0:1789518076.816089:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616936960 00000100:00100000:0.0:1789518076.816175:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:0.0:1789518076.816183:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2342:x1876445616936960:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518076.816229:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2342:x1876445616936960:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 47us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518076.816238:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00080000:2.0:1789518076.816430:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789518077.362753:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518077.556732:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789518077.556753:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627449600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518077.556811:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518077.557017:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627449600 00000100:00100000:3.0:1789518077.557025:0:6652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627449600 00000100:00100000:3.0:1789518077.557070:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789518077.557077:0:6652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627449600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789518077.557165:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789518077.557207:0:6652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627449600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518077.557214:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789518077.557249:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffff666680 x1876445627449600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518093 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518077.557264:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627449600:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789518077.557442:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789518078.387234:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789518079.411963:0:9010:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing yml_node 00010000:00010000:3.0:1789518079.412999:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518080.434851:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518080.626826:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627449856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518080.626904:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518080.627060:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:824c8f07-28fa-48fd-81af-173b194570e6:3280:1876445627449728:0@lo:400:kworker.0 00000100:00100000:0.0:1789518080.627095:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518080.627120:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627450240:0@lo:400:kworker.0 00000100:00100000:0.0:1789518080.627144:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518080.627168:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789518080.627174:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627450368:0@lo:400:kworker.0 00000100:00100000:0.0:1789518080.627195:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518080.627224:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627449728 00000100:00100000:0.0:1789518080.627231:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627449728 00000100:00100000:0.0:1789518080.627273:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789518080.627300:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc777ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+19:3280:x1876445627449728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518080.627346:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc777ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+19:3280:x1876445627449728:12345-0@lo:400:kworker.0 Request processed in 48us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518080.627353:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789518080.627382:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627450240 00000100:00100000:0.0:1789518080.627385:0:6649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627450240 00000100:00100000:0.0:1789518080.627418:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789518080.627424:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627450240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518080.627453:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627450240:12345-0@lo:400:kworker.0 Request processed in 29us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518080.627459:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789518080.627476:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627450368 00000100:00100000:0.0:1789518080.627479:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627450368 00000100:00100000:0.0:1789518080.627501:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789518080.627506:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627450368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518080.627534:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627450368:12345-0@lo:400:kworker.0 Request processed in 27us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518080.627540:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789518080.627576:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627450368:0@lo:400:kworker.0 00000100:00100000:0.0:1789518080.627585:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:824c8f07-28fa-48fd-81af-173b194570e6:3280:1876445627449728:0@lo:400:kworker.0 00010000:00080000:0.0:1789518080.627595:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffff664700 x1876445627450240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518080.627605:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627450240:0@lo:400:kworker.0 00000100:00080000:0.0:1789518080.627673:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789518080.627678:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518080.627693:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627450112:0@lo:400:kworker.0 00000100:00100000:0.0:1789518080.627717:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518080.627735:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789518080.627740:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627449984:0@lo:400:kworker.0 00000100:00100000:0.0:1789518080.627762:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518080.627785:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627450112 00000100:00100000:0.0:1789518080.627788:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627450112 00000100:00100000:0.0:1789518080.627808:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627449984 00000100:00100000:0.0:1789518080.627811:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627449984 00000100:00100000:0.0:1789518080.627829:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789518080.627835:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627450112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518080.627866:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627450112:12345-0@lo:400:kworker.0 Request processed in 30us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518080.627871:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789518080.627882:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789518080.627887:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627449984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518080.627908:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627449984:12345-0@lo:400:kworker.0 Request processed in 21us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518080.627913:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1789518080.627931:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518080.627945:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627449984:0@lo:400:kworker.0 00000100:00100000:0.0:1789518080.627953:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627450112:0@lo:400:kworker.0 00000100:00100000:0.0:1789518080.627984:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627449856 00000100:00100000:0.0:1789518080.627988:0:6652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627449856 00000100:00100000:0.0:1789518080.628012:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789518080.628018:0:6652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4002300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627449856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789518080.628057:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789518080.632087:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518080.632179:0:6652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4002300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627449856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4157us (5270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518080.632191:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1789518080.632656:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fff79af480 x1876445627449856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518096 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518080.632675:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627449856:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789518081.458761:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518081.934811:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518081.934841:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518081.934862:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518081.934885:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518081.934907:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616937600 00000100:00100000:3.0:1789518081.934915:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616937600 00000100:00100000:3.0:1789518081.934968:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616937728 00000100:00100000:3.0:1789518081.934972:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616937728 00000100:00100000:3.0:1789518081.934993:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:3.0:1789518081.935002:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff667b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2343:x1876445616937600:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518081.935147:0:8784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:2.0:1789518081.935162:0:8784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2343:x1876445616937728:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518081.935278:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff667b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2343:x1876445616937600:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 266us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518081.935286:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:3.0:1789518081.935309:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616937472 00000100:00100000:3.0:1789518081.935313:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616937472 00000100:00100000:3.0:1789518081.935340:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:3.0:1789518081.935348:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2343:x1876445616937472:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518081.935591:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616937344 00000100:00100000:1.0:1789518081.935595:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616937344 00000100:00100000:1.0:1789518081.935638:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 188 00000100:00100000:1.0:1789518081.935645:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc777b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+10:2343:x1876445616937344:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518081.935751:0:8784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2343:x1876445616937728:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 589us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518081.935757:0:8784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:3.0:1789518081.936339:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2343:x1876445616937472:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 991us (1474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518081.936347:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00080000:3.0:1789518081.936364:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789518081.936369:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789518081.936371:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518081.939743:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc777b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+10:2343:x1876445616937344:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 4086us (4928us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518081.939756:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 188 00000001:02000400:2.0:1789518082.110265:0:9202:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00010000:00010000:2.0:1789518082.485895:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518082.676306:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627450496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518082.676446:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518082.676691:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627450496 00000100:00100000:3.0:1789518082.676700:0:6651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627450496 00000100:00100000:3.0:1789518082.676768:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789518082.676777:0:6651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4000380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627450496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789518082.676806:0:6651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789518082.676871:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518082.677448:0:6651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4000380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627450496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 671us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518082.677459:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1789518082.678085:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffeda6b800 x1876445627450496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518098 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518082.678118:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627450496:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789518083.507745:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789518083.595777:0:9299:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00010000:00010000:3.0:1789518084.531784:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789518085.185933:0:9397:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00010000:00010000:2.0:1789518085.554824:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518085.747031:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4001c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627451008:0@lo:400:kworker.0 00000100:00100000:1.0:1789518085.747098:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518085.747145:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789518085.747152:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4000e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:824c8f07-28fa-48fd-81af-173b194570e6:3282:1876445627450624:0@lo:400:kworker.0 00000100:00100000:1.0:1789518085.747183:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518085.747205:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4003b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627451136:0@lo:400:kworker.0 00000100:00100000:1.0:1789518085.747273:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518085.747301:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4001880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627450752:0@lo:400:kworker.0 00000100:00100000:1.0:1789518085.747337:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518085.747356:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4001f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627451264:0@lo:400:kworker.0 00000100:00100000:1.0:1789518085.747375:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518085.747393:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789518085.747399:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4000000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627450880:0@lo:400:kworker.0 00000100:00100000:1.0:1789518085.747418:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518085.747447:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627451008 00000100:00100000:1.0:1789518085.747453:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627451008 00000100:00100000:0.0:1789518085.747500:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627451136 00000100:00100000:0.0:1789518085.747505:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627451136 00000100:00100000:1.0:1789518085.747514:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627451264 00000100:00100000:1.0:1789518085.747519:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627451264 00000100:00100000:0.0:1789518085.747541:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627450752 00000100:00100000:0.0:1789518085.747546:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627450752 00000100:00100000:1.0:1789518085.747551:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789518085.747562:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4002680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627451008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518085.747568:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627450880 00000100:00100000:0.0:1789518085.747572:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627450880 00000100:00100000:0.0:1789518085.747591:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789518085.747600:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff6f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876445627451136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518085.747635:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4002680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627451008:12345-0@lo:400:kworker.0 Request processed in 51us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518085.747644:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789518085.747660:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789518085.747667:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff6f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627451264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518085.747682:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff6f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876445627451136:12345-0@lo:400:kworker.0 Request processed in 83us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518085.747690:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789518085.747708:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff6f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627451264:12345-0@lo:400:kworker.0 Request processed in 40us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518085.747713:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789518085.747721:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789518085.747726:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff6f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627450752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518085.747748:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789518085.747758:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff6f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627450880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518085.747764:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff6f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627450752:12345-0@lo:400:kworker.0 Request processed in 42us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518085.747772:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789518085.747794:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff6f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627450880:12345-0@lo:400:kworker.0 Request processed in 37us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518085.747796:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627450624 00000100:00100000:0.0:1789518085.747801:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627450624 00000100:00100000:1.0:1789518085.747812:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789518085.747831:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789518085.747839:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc8101c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+19:3282:x1876445627450624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518085.747871:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4000000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627450880:0@lo:400:kworker.0 00000100:00100000:0.0:1789518085.747877:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc8101c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+19:3282:x1876445627450624:12345-0@lo:400:kworker.0 Request processed in 37us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518085.747885:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789518085.747887:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4001880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627450752:0@lo:400:kworker.0 00010000:00080000:1.0:1789518085.747900:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fff4001f80 x1876445627451264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518085.747911:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4001f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627451264:0@lo:400:kworker.0 00000100:00100000:1.0:1789518085.747956:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4000e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:824c8f07-28fa-48fd-81af-173b194570e6:3282:1876445627450624:0@lo:400:kworker.0 00000100:00100000:1.0:1789518085.747967:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4003b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627451136:0@lo:400:kworker.0 00000100:00080000:0.0:1789518085.747971:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789518085.747977:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789518085.747978:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fff4001c00 x1876445627451008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789518085.747981:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518085.747990:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4001c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627451008:0@lo:400:kworker.0 00000100:00100000:1.0:1789518085.749115:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627451392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518085.749149:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518085.749246:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627451392 00000100:00100000:0.0:1789518085.749260:0:6652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627451392 00000100:00100000:0.0:1789518085.749292:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789518085.749300:0:6652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff6f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627451392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789518085.749325:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789518085.749402:0:6652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff6f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627451392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518085.749409:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1789518085.749554:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fff79aca80 x1876445627451392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518101 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518085.749568:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627451392:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1789518086.150262:0:9445:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 15 20:21:25 EDT 2026 00010000:00010000:3.0:1789518086.580207:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518087.054811:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518087.054849:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518087.054868:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518087.054921:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518087.054974:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616937984 00000100:00100000:1.0:1789518087.054983:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616937984 00000100:00100000:1.0:1789518087.055057:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:1.0:1789518087.055067:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2345:x1876445616937984:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518087.055132:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2345:x1876445616937984:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 67us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518087.055149:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:1.0:1789518087.055171:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616937856 00000100:00100000:1.0:1789518087.055175:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616937856 00000100:00100000:1.0:1789518087.055198:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 190 00000100:00100000:1.0:1789518087.055203:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc8103450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+10:2344:x1876445616937856:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518087.055229:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc8103450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+10:2344:x1876445616937856:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 25us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518087.055235:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 190 00000100:00100000:1.0:1789518087.055272:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616938112 00000100:00100000:1.0:1789518087.055276:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616938112 00000100:00100000:1.0:1789518087.055297:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616938240 00000100:00100000:1.0:1789518087.055300:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616938240 00000100:00100000:1.0:1789518087.055319:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:1.0:1789518087.055324:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2344:x1876445616938112:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518087.055348:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2344:x1876445616938112:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 24us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518087.055355:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:1.0:1789518087.055367:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:1.0:1789518087.055373:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2345:x1876445616938240:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518087.055397:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2345:x1876445616938240:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 24us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518087.055403:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00080000:2.0:1789518087.055673:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789518087.055677:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789518087.055680:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789518087.608587:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518087.797695:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627451520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518087.797759:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518087.797878:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627451520 00000100:00100000:0.0:1789518087.797886:0:6651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627451520 00000100:00100000:0.0:1789518087.797944:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789518087.797953:0:6651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff6f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627451520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518087.797984:0:6651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789518087.798028:0:6651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff6f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627451520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518087.798034:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1789518087.798088:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789518087.798117:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffeda6b100 x1876445627451520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518103 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518087.798134:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627451520:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789518088.626814:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518089.651871:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518090.674753:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518090.867524:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627451648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518090.867583:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518090.867821:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627451648 00000100:00100000:2.0:1789518090.867829:0:6651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627451648 00000100:00100000:2.0:1789518090.867881:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789518090.867889:0:6651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627451648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789518090.867918:0:6651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789518090.867955:0:6651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627451648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518090.867962:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1789518090.867993:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fff79ace00 x1876445627451648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518106 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518090.868008:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627451648:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789518090.869371:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518090.869413:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789518090.869426:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627452032:0@lo:400:kworker.0 00000100:00100000:3.0:1789518090.869466:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518090.869466:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876445627451904:0@lo:400:kworker.0 00000100:00100000:0.0:1789518090.869499:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518090.869518:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789518090.869523:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:824c8f07-28fa-48fd-81af-173b194570e6:3281:1876445627451776:0@lo:400:kworker.0 00000100:00100000:3.0:1789518090.869527:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627452160:0@lo:400:kworker.0 00000100:00100000:3.0:1789518090.869549:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518090.869562:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518090.869580:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627452032 00000100:00100000:0.0:1789518090.869583:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627452288:0@lo:400:kworker.0 00000100:00100000:3.0:1789518090.869585:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627452032 00000100:00100000:0.0:1789518090.869602:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518090.869634:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627451904 00000100:00100000:0.0:1789518090.869637:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627451776 00000100:00100000:3.0:1789518090.869638:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627451904 00000100:00100000:0.0:1789518090.869640:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627451776 00000100:00100000:3.0:1789518090.869650:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627452288 00000100:00100000:3.0:1789518090.869652:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627452288 00000100:00100000:0.0:1789518090.869662:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789518090.869664:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789518090.869668:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc8103050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+19:3281:x1876445627451776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518090.869669:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627452032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518090.869703:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627452032:12345-0@lo:400:kworker.0 Request processed in 32us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518090.869703:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc8103050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+19:3281:x1876445627451776:12345-0@lo:400:kworker.0 Request processed in 35us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518090.869710:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789518090.869710:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789518090.869723:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789518090.869728:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876445627451904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518090.869743:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:824c8f07-28fa-48fd-81af-173b194570e6:3281:1876445627451776:0@lo:400:kworker.0 00000100:00100000:3.0:1789518090.869760:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876445627451904:12345-0@lo:400:kworker.0 Request processed in 32us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518090.869760:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876445627451904:0@lo:400:kworker.0 00000100:00100000:3.0:1789518090.869766:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789518090.869778:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789518090.869784:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627452288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518090.869819:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627452288:12345-0@lo:400:kworker.0 Request processed in 35us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518090.869824:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1789518090.869837:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518090.869854:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627452032:0@lo:400:kworker.0 00000100:00100000:1.0:1789518090.869939:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627452160 00000100:00100000:1.0:1789518090.869944:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627452160 00000100:00100000:1.0:1789518090.869981:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789518090.869987:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627452288:0@lo:400:kworker.0 00000100:00100000:1.0:1789518090.869988:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627452160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518090.870038:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627452160:12345-0@lo:400:kworker.0 Request processed in 51us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518090.870045:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1789518090.870100:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffff665500 x1876445627452160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518090.870110:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627452160:0@lo:400:kworker.0 00000100:00080000:3.0:1789518090.870189:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789518091.700761:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518092.174396:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518092.174475:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518092.174565:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616938368 00000100:00100000:2.0:1789518092.174573:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616938496 00000100:00100000:1.0:1789518092.174575:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616938368 00000100:00100000:2.0:1789518092.174585:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616938496 00000100:00100000:2.0:1789518092.174674:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:2.0:1789518092.174685:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2344:x1876445616938496:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518092.174752:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2344:x1876445616938496:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 69us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518092.174763:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:1.0:1789518092.174764:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 192 00000100:00100000:1.0:1789518092.174777:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7646450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+10:2344:x1876445616938368:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518092.174809:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7646450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+10:2344:x1876445616938368:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 36us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518092.174817:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 192 00000100:00080000:0.0:1789518092.174918:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518092.181245:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518092.181324:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518092.182533:0:6647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616938624 00000100:00100000:1.0:1789518092.182543:0:6647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616938624 00000100:00100000:1.0:1789518092.182591:0:6647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616938752 00000100:00100000:1.0:1789518092.182593:0:6647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616938752 00000100:00100000:3.0:1789518092.182602:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00080000:0.0:1789518092.182676:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789518092.182681:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518092.182735:0:6647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:1.0:1789518092.182744:0:6647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2341:x1876445616938752:12345-192.168.206.51@tcp:9:kworker.0 00000020:00000080:1.0:1789518092.182781:0:6647:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c780c2b 00000100:00080000:1.0:1789518092.182791:0:6647:0:(import.c:65:import_set_state_nolock()) ffff99ffc6bdf800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789518092.182830:0:6647:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789518092.183186:0:6647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+2:2341:x1876445616938752:12345-192.168.206.51@tcp:9:kworker.0 Request processed in 443us (1861us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518092.183257:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2341:x1876445616938624:12345-192.168.206.51@tcp:9:kworker.0 00000020:00000080:3.0:1789518092.183274:0:6649:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c780c24 00000100:00080000:3.0:1789518092.183281:0:6649:0:(import.c:65:import_set_state_nolock()) ffff99ffffbf1800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789518092.183396:0:6649:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789518092.183718:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+2:2341:x1876445616938624:12345-192.168.206.51@tcp:9:kworker.0 Request processed in 1107us (2480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518092.184547:0:6647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00010000:00010000:0.0:1789518092.184572:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518092.184755:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00010000:00010000:3.0:1789518092.184888:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518092.722989:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518092.914896:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789518092.914916:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627452416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518092.914995:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518092.915594:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627452416 00000100:00100000:2.0:1789518092.915602:0:6651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627452416 00000100:00100000:2.0:1789518092.915735:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789518092.915745:0:6651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627452416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789518092.915775:0:6651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789518092.915831:0:6651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627452416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518092.915838:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1789518092.915878:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789518092.915914:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffeda6a300 x1876445627452416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518108 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518092.915935:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627452416:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1789518092.941559:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cfa1c47d-1425-4fe5-be2a-28ad5152a12d 00000020:00000080:3.0:1789518092.941566:0:6674:0:(genops.c:885:class_export_put()) final put ffff99ffffbf7000/cfa1c47d-1425-4fe5-be2a-28ad5152a12d 00000020:00000080:2.0:1789518092.941755:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffffbf7000/cfa1c47d-1425-4fe5-be2a-28ad5152a12d for lustre-OST0000 00000020:00000080:2.0:1789518092.941940:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffffbf1800 for lustre-OST0000 00010000:00010000:3.0:1789518093.747281:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789518094.122388:0:10074:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 20:21:33 (1789518093) === 00000100:00100000:2.0:1789518094.423038:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518094.423110:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616938880 00000100:00100000:1.0:1789518094.423119:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616938880 00000100:00100000:1.0:1789518094.423181:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 193 00000100:00100000:1.0:1789518094.423191:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7645450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+10:8096:x1876445616938880:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789518094.423218:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518094.423235:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc0031a00/0x631fd8698c780cef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc656 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518094.423262:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc0031a00/0x631fd8698c780cef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc656 expref: 11 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518094.423273:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc0031a00/0x631fd8698c780cef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc656 expref: 11 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518094.423282:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc0031a00, rc 0) 00000100:00100000:1.0:1789518094.423438:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7645450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+11:8096:x1876445616938880:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 248us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518094.423446:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 193 00000100:00100000:0.0:1789518094.427662:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518094.428050:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616939008 00000100:00100000:2.0:1789518094.428059:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616939008 00000100:00100000:2.0:1789518094.428114:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 194 00000100:00100000:2.0:1789518094.428131:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7644c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+11:8096:x1876445616939008:12345-192.168.206.51@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789518094.428445:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7644c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+11:8096:x1876445616939008:12345-192.168.206.51@tcp:501:mount.lustre.0 Request processed in 321us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518094.428462:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 194 00000100:00100000:2.0:1789518094.431085:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518094.431182:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616939136 00000100:00100000:1.0:1789518094.431191:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616939136 00000100:00100000:1.0:1789518094.431264:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 195 00000100:00100000:1.0:1789518094.431273:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7644050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+11:8096:x1876445616939136:12345-192.168.206.51@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789518094.431478:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7644050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+11:8096:x1876445616939136:12345-192.168.206.51@tcp:503:mount.lustre.0 Request processed in 205us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518094.431485:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 195 00000100:00100000:3.0:1789518094.435236:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518094.435392:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616939264 00000100:00100000:0.0:1789518094.435406:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616939264 00000100:00100000:0.0:1789518094.435547:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 196 00000100:00100000:0.0:1789518094.435559:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7644450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+11:8100:x1876445616939264:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789518094.435934:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7644450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+11:8100:x1876445616939264:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 375us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518094.435943:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 196 00000100:00100000:0.0:1789518094.443158:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518094.443318:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616939392 00000100:00100000:2.0:1789518094.443330:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616939392 00000100:00100000:2.0:1789518094.443395:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 197 00000100:00100000:2.0:1789518094.443406:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7647850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+11:8100:x1876445616939392:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789518094.443972:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7647850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+11:8100:x1876445616939392:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 565us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518094.443981:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 197 00000100:00100000:2.0:1789518094.449123:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518094.449397:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616939520 00000100:00100000:0.0:1789518094.449410:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616939520 00000100:00100000:1.0:1789518094.449535:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 198 00000100:00100000:1.0:1789518094.449550:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7645850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+11:8096:x1876445616939520:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789518094.449572:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518094.449596:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc0030200/0x631fd8698c780cf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc680 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518094.449664:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc0030200/0x631fd8698c780cf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc680 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518094.449678:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc0030200/0x631fd8698c780cf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc680 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518094.449689:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc0030200, rc 0) 00000100:00100000:1.0:1789518094.449817:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7645850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+12:8096:x1876445616939520:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 270us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518094.449824:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 198 00000100:00100000:3.0:1789518094.454105:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518094.454298:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616939648 00000100:00100000:2.0:1789518094.454311:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616939648 00000100:00100000:2.0:1789518094.454370:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 199 00000100:00100000:2.0:1789518094.454380:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7645050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+12:8096:x1876445616939648:12345-192.168.206.51@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789518094.454412:0:5806:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789518094.454441:0:5806:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789518094.454444:0:5806:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789518094.454446:0:5806:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789518094.454448:0:5806:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1789518094.455676:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7645050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+12:8096:x1876445616939648:12345-192.168.206.51@tcp:256:mount.lustre.0 Request processed in 1286us (1574us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518094.455689:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 199 00000100:00100000:1.0:1789518094.459347:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518094.460966:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616939776 00000100:00100000:0.0:1789518094.460990:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616939776 00000100:00100000:0.0:1789518094.461077:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 200 00000100:00100000:0.0:1789518094.461089:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7646850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+12:8096:x1876445616939776:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789518094.461110:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518094.461133:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc28d000/0x631fd8698c780cfd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc687 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518094.461168:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc28d000/0x631fd8698c780cfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc687 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518094.461182:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc28d000/0x631fd8698c780cfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc687 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518094.461223:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28d000, rc 0) 00000100:00100000:0.0:1789518094.461309:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7646850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+13:8096:x1876445616939776:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 222us (1975us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518094.461317:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 200 00000100:00100000:3.0:1789518094.464945:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518094.465477:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616939904 00000100:00100000:0.0:1789518094.465490:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616939904 00000100:00100000:0.0:1789518094.465565:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 201 00000100:00100000:0.0:1789518094.465577:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7646c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+13:8096:x1876445616939904:12345-192.168.206.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789518094.465996:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7646c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+13:8096:x1876445616939904:12345-192.168.206.51@tcp:501:mount.lustre.0 Request processed in 420us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518094.466007:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 201 00000100:00100000:2.0:1789518094.468718:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518094.468798:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616940032 00000100:00100000:1.0:1789518094.468810:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616940032 00000100:00100000:1.0:1789518094.468872:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 202 00000100:00100000:1.0:1789518094.468882:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7647450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+13:8096:x1876445616940032:12345-192.168.206.51@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789518094.469150:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7647450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+13:8096:x1876445616940032:12345-192.168.206.51@tcp:503:mount.lustre.0 Request processed in 270us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518094.469164:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 202 00000100:00100000:1.0:1789518094.472662:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518094.474330:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616940160 00000100:00100000:0.0:1789518094.474358:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616940160 00000100:00100000:0.0:1789518094.474451:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 203 00000100:00100000:0.0:1789518094.474463:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7647050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+13:8103:x1876445616940160:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789518094.474814:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7647050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+13:8103:x1876445616940160:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 349us (2161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518094.474824:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 203 00000100:00100000:3.0:1789518094.477690:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518094.478001:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616940288 00000100:00100000:0.0:1789518094.478013:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616940288 00000100:00100000:0.0:1789518094.478078:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 204 00000100:00100000:0.0:1789518094.478091:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7647c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+13:8103:x1876445616940288:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789518094.478536:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7647c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+13:8103:x1876445616940288:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 447us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518094.478555:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 204 00000100:00100000:2.0:1789518094.486174:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518094.486247:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518094.486515:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616940416 00000100:00100000:3.0:1789518094.486529:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616940416 00000100:00100000:3.0:1789518094.486654:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616940800 00000100:00100000:3.0:1789518094.486658:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616940800 00000100:00100000:3.0:1789518094.486709:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:3.0:1789518094.486721:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2343:x1876445616940800:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518094.486845:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2343:x1876445616940800:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 126us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518094.486854:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00080000:0.0:1789518094.487067:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518094.487101:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:0.0:1789518094.487108:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2341:x1876445616940416:12345-192.168.206.51@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789518094.487136:0:5811:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 0e523f9d-cd98-44af-a94f-935bacbf145f@192.168.206.51@tcp t0 exp 0000000000000000 cur 148 last 0 00000020:00000080:0.0:1789518094.487183:0:5811:0:(genops.c:1384:class_connect()) connect: client 0e523f9d-cd98-44af-a94f-935bacbf145f, cookie 0x631fd8698c780d04 00000004:00100000:0.0:1789518094.487229:0:5811:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789518094.488827:0:5811:0:(import.c:65:import_set_state_nolock()) ffff99ffc4f43800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789518094.489009:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e523f9d-cd98-44af-a94f-935bacbf145f+6:2341:x1876445616940416:12345-192.168.206.51@tcp:38:mount.lustre.0 Request processed in 1888us (2837us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518094.489021:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:2.0:1789518094.493567:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518094.493696:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518094.493873:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616940672 00000100:00100000:3.0:1789518094.493886:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616940672 00000100:00100000:3.0:1789518094.493966:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616940544 00000100:00100000:3.0:1789518094.493970:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616940544 00000100:00100000:3.0:1789518094.494003:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:3.0:1789518094.494016:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e523f9d-cd98-44af-a94f-935bacbf145f+7:8096:x1876445616940672:12345-192.168.206.51@tcp:41:mount.lustre.0 00000100:00080000:0.0:1789518094.494018:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518094.494065:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000004:00000024:3.0:1789518094.494076:0:8051:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789518094.494096:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e523f9d-cd98-44af-a94f-935bacbf145f+7:0:x1876445616940544:12345-192.168.206.51@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789518094.494128:0:5811:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789518094.494197:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e523f9d-cd98-44af-a94f-935bacbf145f+7:8096:x1876445616940672:12345-192.168.206.51@tcp:41:mount.lustre.0 Request processed in 181us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518094.494200:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e523f9d-cd98-44af-a94f-935bacbf145f+7:0:x1876445616940544:12345-192.168.206.51@tcp:41:mount.lustre.0 Request processed in 121us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518094.494229:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:0.0:1789518094.494325:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:1.0:1789518094.499308:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518094.499458:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616940928 00000100:00100000:3.0:1789518094.499476:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616940928 00000100:00100000:3.0:1789518094.499554:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:3.0:1789518094.499565:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff6f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e523f9d-cd98-44af-a94f-935bacbf145f+6:8096:x1876445616940928:12345-192.168.206.51@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789518094.499781:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff6f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e523f9d-cd98-44af-a94f-935bacbf145f+6:8096:x1876445616940928:12345-192.168.206.51@tcp:40:mount.lustre.0 Request processed in 217us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518094.499816:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:3.0:1789518094.504297:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518094.504333:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518094.504474:0:8784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616941056 00000100:00100000:0.0:1789518094.504488:0:8784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616941056 00000100:00100000:3.0:1789518094.504580:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518094.504596:0:8784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616941184 00000100:00100000:0.0:1789518094.504602:0:8784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616941184 00000100:00100000:0.0:1789518094.504669:0:8784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:0.0:1789518094.504679:0:8784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2341:x1876445616941056:12345-192.168.206.51@tcp:8:mount.lustre.0 00000100:00100000:1.0:1789518094.504703:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:1.0:1789518094.504709:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2341:x1876445616941184:12345-192.168.206.51@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789518094.504718:0:8784:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 0e523f9d-cd98-44af-a94f-935bacbf145f@192.168.206.51@tcp t0 exp 0000000000000000 cur 148 last 0 00010000:00080000:1.0:1789518094.504724:0:6648:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 0e523f9d-cd98-44af-a94f-935bacbf145f@192.168.206.51@tcp t0 exp 0000000000000000 cur 148 last 0 00000100:00100000:3.0:1789518094.504754:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616941312 00000020:00000080:0.0:1789518094.504762:0:8784:0:(genops.c:1384:class_connect()) connect: client 0e523f9d-cd98-44af-a94f-935bacbf145f, cookie 0x631fd8698c780d12 00000100:00100000:3.0:1789518094.504763:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616941312 00000020:00000080:1.0:1789518094.504772:0:6648:0:(genops.c:1384:class_connect()) connect: client 0e523f9d-cd98-44af-a94f-935bacbf145f, cookie 0x631fd8698c780d0b 00002000:00100000:1.0:1789518094.504780:0:6648:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0e523f9d-cd98-44af-a94f-935bacbf145f/ffff99fff7b5b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789518094.504780:0:8784:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0e523f9d-cd98-44af-a94f-935bacbf145f/ffff99ffc4f44000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789518094.504808:0:6648:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00100000:0.0:1789518094.504808:0:8784:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1789518094.504820:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:3.0:1789518094.504841:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e523f9d-cd98-44af-a94f-935bacbf145f+6:8096:x1876445616941312:12345-192.168.206.51@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789518094.504926:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00002000:00080000:1.0:1789518094.504936:0:6648:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789518094.504972:0:6648:0:(import.c:65:import_set_state_nolock()) ffff99fff7b5e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789518094.505021:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e523f9d-cd98-44af-a94f-935bacbf145f+6:8096:x1876445616941312:12345-192.168.206.51@tcp:33:mount.lustre.0 Request processed in 187us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518094.505031:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e523f9d-cd98-44af-a94f-935bacbf145f+6:2341:x1876445616941184:12345-192.168.206.51@tcp:8:mount.lustre.0 Request processed in 318us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518094.505033:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:1.0:1789518094.505048:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00002000:00080000:0.0:1789518094.505075:0:8784:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789518094.505092:0:8784:0:(import.c:65:import_set_state_nolock()) ffff99ffc4f40800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789518094.505118:0:8784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e523f9d-cd98-44af-a94f-935bacbf145f+6:2341:x1876445616941056:12345-192.168.206.51@tcp:8:mount.lustre.0 Request processed in 439us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518094.505125:0:8784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00010000:00010000:0.0:1789518094.773556:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518095.795987:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518095.986836:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627452800:0@lo:400:kworker.0 00000100:00100000:3.0:1789518095.986893:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518095.986988:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff497b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627452672:0@lo:400:kworker.0 00000100:00100000:3.0:1789518095.987010:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518095.987020:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627452928:0@lo:400:kworker.0 00000100:00100000:0.0:1789518095.987027:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518095.987049:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627453184:0@lo:400:kworker.0 00000100:00100000:3.0:1789518095.987057:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518095.987078:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518095.987099:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627452800 00000100:00100000:3.0:1789518095.987106:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627452800 00000100:00100000:0.0:1789518095.987125:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789518095.987133:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:824c8f07-28fa-48fd-81af-173b194570e6:3283:1876445627452544:0@lo:400:kworker.0 00000100:00100000:3.0:1789518095.987152:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627452672 00000100:00100000:3.0:1789518095.987156:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627452672 00000100:00100000:0.0:1789518095.987163:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518095.987186:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789518095.987192:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff497aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627453056:0@lo:400:kworker.0 00000100:00100000:3.0:1789518095.987198:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff497bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627452800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518095.987232:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518095.987364:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627452928 00000100:00100000:0.0:1789518095.987369:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627452928 00000100:00100000:0.0:1789518095.987399:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627453184 00000100:00100000:0.0:1789518095.987403:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627453184 00000100:00100000:0.0:1789518095.987422:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789518095.987428:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff497ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627452928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518095.987568:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627453056 00000100:00100000:2.0:1789518095.987573:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627453056 00000100:00100000:2.0:1789518095.987601:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789518095.987609:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627452672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518095.987907:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff497bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627452800:12345-0@lo:400:kworker.0 Request processed in 713us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518095.987942:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff497ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627452928:12345-0@lo:400:kworker.0 Request processed in 512us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518095.987958:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789518095.987977:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789518095.987983:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789518095.987987:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627453184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518095.988004:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789518095.988012:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627453056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518095.988032:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627453184:12345-0@lo:400:kworker.0 Request processed in 48us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518095.988039:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789518095.988055:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627453056:12345-0@lo:400:kworker.0 Request processed in 42us (820us total) trans 0 rc 0/0 00000100:00080000:0.0:1789518095.988061:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518095.988062:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1789518095.988068:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789518095.988073:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518095.988086:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627452544 00010000:00080000:3.0:1789518095.988108:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fff4979880 x1876445627452928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518095.988120:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627452928:0@lo:400:kworker.0 00000100:00100000:3.0:1789518095.988129:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627452800:0@lo:400:kworker.0 00000100:00100000:3.0:1789518095.988184:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789518095.988192:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627453312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518095.988214:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627452544 00000100:00100000:3.0:1789518095.988235:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518095.988263:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627453312 00000100:00100000:3.0:1789518095.988267:0:6652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627453312 00000100:00100000:3.0:1789518095.988289:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789518095.988296:0:6652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4979880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627453312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789518095.988310:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789518095.988313:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789518095.988325:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+19:3283:x1876445627452544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518095.988351:0:6652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4979880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627453312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518095.988358:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789518095.988371:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+19:3283:x1876445627452544:12345-0@lo:400:kworker.0 Request processed in 49us (1208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518095.988379:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00010000:00080000:3.0:1789518095.988390:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fff4978000 x1876445627453312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518111 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518095.988404:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627453312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518095.988434:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:824c8f07-28fa-48fd-81af-173b194570e6:3283:1876445627452544:0@lo:400:kworker.0 00000100:00100000:0.0:1789518095.988717:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff497aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627453056:0@lo:400:kworker.0 00010000:00080000:0.0:1789518095.988731:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fff4979c00 x1876445627453184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518095.988740:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627453184:0@lo:400:kworker.0 00000100:00100000:2.0:1789518095.988878:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627452672:12345-0@lo:400:kworker.0 Request processed in 1270us (1853us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518095.988884:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789518095.988955:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff497b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627452672:0@lo:400:kworker.0 00000001:00100000:3.0:1789518096.536025:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0e523f9d-cd98-44af-a94f-935bacbf145f 00000001:00100000:1.0:1789518096.543236:0:7607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0e523f9d-cd98-44af-a94f-935bacbf145f 00000001:00100000:1.0:1789518096.543308:0:7607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cfa1c47d-1425-4fe5-be2a-28ad5152a12d 00000020:00000080:1.0:1789518096.543312:0:7607:0:(genops.c:885:class_export_put()) final put ffff99ffee440000/cfa1c47d-1425-4fe5-be2a-28ad5152a12d 00000020:00000080:0.0:1789518096.543383:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffee440000/cfa1c47d-1425-4fe5-be2a-28ad5152a12d for lustre-OST0001 00000020:00000080:0.0:1789518096.543446:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffc6bdf800 for lustre-OST0001 00010000:00010000:0.0:1789518096.820390:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518097.552175:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518097.552254:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518097.552279:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518097.552305:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518097.552343:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518097.552367:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616941952 00000100:00100000:2.0:1789518097.552376:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616941952 00000100:00100000:2.0:1789518097.552423:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616941824 00000100:00100000:2.0:1789518097.552426:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616941824 00000100:00100000:2.0:1789518097.552449:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:2.0:1789518097.552459:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2345:x1876445616941952:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518097.552524:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2345:x1876445616941952:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 67us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518097.552532:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:2.0:1789518097.552559:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:2.0:1789518097.552566:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e523f9d-cd98-44af-a94f-935bacbf145f+6:2345:x1876445616941824:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518097.552591:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e523f9d-cd98-44af-a94f-935bacbf145f+6:2345:x1876445616941824:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 25us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518097.552596:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:2.0:1789518097.552634:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616941696 00000100:00100000:2.0:1789518097.552637:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616941696 00000100:00100000:2.0:1789518097.552670:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616941568 00000100:00100000:2.0:1789518097.552673:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616941568 00000100:00100000:2.0:1789518097.552691:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00100000:2.0:1789518097.552698:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2345:x1876445616941696:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518097.552726:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2345:x1876445616941696:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 29us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518097.552731:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00100000:2.0:1789518097.552741:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:2.0:1789518097.552747:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2345:x1876445616941568:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518097.552769:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2345:x1876445616941568:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 22us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518097.552775:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00080000:2.0:1789518097.552792:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789518097.552796:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789518097.552798:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518097.553051:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616941440 00000100:00100000:0.0:1789518097.553055:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616941440 00000100:00100000:0.0:1789518097.553092:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 206 00000100:00100000:0.0:1789518097.553099:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+13:2345:x1876445616941440:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518097.553132:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+13:2345:x1876445616941440:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 34us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518097.553139:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 206 00010000:00010000:3.0:1789518097.842748:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789518098.027340:0:10272:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:0.0:1789518098.035502:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789518098.035530:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627453440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518098.035642:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518098.035718:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627453440 00000100:00100000:0.0:1789518098.035728:0:6652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627453440 00000100:00080000:2.0:1789518098.035761:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518098.035815:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789518098.035827:0:6652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627453440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518098.035873:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789518098.035933:0:6652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627453440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518098.035940:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1789518098.036223:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffeda6a300 x1876445627453440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518114 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518098.036246:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627453440:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1789518098.097933:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0e523f9d-cd98-44af-a94f-935bacbf145f 00010000:00010000:0.0:1789518098.868593:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518099.890890:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518100.914866:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518101.106775:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff497a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627453696:0@lo:400:kworker.0 00000100:00100000:3.0:1789518101.106805:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff497b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627453952:0@lo:400:kworker.0 00000100:00100000:3.0:1789518101.106858:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518101.106901:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789518101.106908:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627453824:0@lo:400:kworker.0 00000100:00100000:0.0:1789518101.106925:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518101.106957:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518101.106964:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627454208:0@lo:400:kworker.0 00000100:00100000:3.0:1789518101.106990:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627453696 00000100:00100000:0.0:1789518101.106995:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518101.106998:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627453696 00000100:00100000:0.0:1789518101.107031:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789518101.107040:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627453824 00000100:00100000:0.0:1789518101.107040:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:824c8f07-28fa-48fd-81af-173b194570e6:3283:1876445627453568:0@lo:400:kworker.0 00000100:00100000:3.0:1789518101.107046:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627453824 00000100:00100000:3.0:1789518101.107073:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789518101.107080:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627453696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518101.107121:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627453696:12345-0@lo:400:kworker.0 Request processed in 41us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518101.107133:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789518101.107149:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789518101.107156:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627453824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518101.107164:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518101.107209:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627453824:12345-0@lo:400:kworker.0 Request processed in 53us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518101.107210:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff497b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627454080:0@lo:400:kworker.0 00000100:00100000:3.0:1789518101.107223:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789518101.107245:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518101.107262:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627453824:0@lo:400:kworker.0 00000100:00100000:0.0:1789518101.107278:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff497a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627453696:0@lo:400:kworker.0 00000100:00100000:3.0:1789518101.107286:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627454080 00000100:00100000:3.0:1789518101.107296:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627454080 00000100:00100000:0.0:1789518101.107308:0:8784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627453952 00000100:00100000:0.0:1789518101.107314:0:8784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627453952 00000100:00100000:3.0:1789518101.107325:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789518101.107333:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627454080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518101.107363:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627454080:12345-0@lo:400:kworker.0 Request processed in 31us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518101.107368:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789518101.107388:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff497b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627454080:0@lo:400:kworker.0 00000100:00100000:3.0:1789518101.107425:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627454208 00000100:00100000:3.0:1789518101.107428:0:6649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627454208 00000100:00100000:3.0:1789518101.107449:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789518101.107454:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627453952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518101.107486:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627453952:12345-0@lo:400:kworker.0 Request processed in 31us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518101.107487:0:8784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789518101.107497:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789518101.107503:0:8784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627454208:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1789518101.107527:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fff497b800 x1876445627453952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518101.107538:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff497b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627453952:0@lo:400:kworker.0 00000100:00100000:0.0:1789518101.107551:0:8784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627454208:12345-0@lo:400:kworker.0 Request processed in 52us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518101.107559:0:8784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1789518101.107564:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fff4979180 x1876445627454208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518101.107574:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627454208:0@lo:400:kworker.0 00000100:00100000:0.0:1789518101.107585:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627453568 00000100:00100000:0.0:1789518101.107591:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627453568 00000100:00100000:0.0:1789518101.108010:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789518101.108018:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+19:3283:x1876445627453568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518101.108122:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+19:3283:x1876445627453568:12345-0@lo:400:kworker.0 Request processed in 38us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518101.108129:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789518101.108597:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627454336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518101.108644:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789518101.108689:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789518101.108694:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789518101.108697:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518101.108722:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627454336 00000100:00100000:2.0:1789518101.108726:0:6651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627454336 00000100:00100000:2.0:1789518101.108753:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789518101.108766:0:6651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627454336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789518101.108790:0:6651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789518101.108828:0:6651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627454336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518101.108910:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1789518101.108951:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffeda7b800 x1876445627454336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518117 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518101.108968:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627454336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518101.108982:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:824c8f07-28fa-48fd-81af-173b194570e6:3283:1876445627453568:0@lo:400:kworker.0 00010000:00010000:0.0:1789518101.938984:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518102.927475:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518102.927511:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518102.927549:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518102.927575:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518102.927600:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518102.927647:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616942208 00000100:00100000:2.0:1789518102.927656:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616942208 00000100:00100000:2.0:1789518102.927703:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616942336 00000100:00100000:2.0:1789518102.927706:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616942336 00000100:00100000:2.0:1789518102.927726:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:2.0:1789518102.927735:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2345:x1876445616942208:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518102.927806:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2345:x1876445616942208:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 66us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518102.927814:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:2.0:1789518102.927829:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 43 00000100:00100000:2.0:1789518102.927835:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2345:x1876445616942336:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518102.927858:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2345:x1876445616942336:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 23us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518102.927875:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 43 00000100:00080000:2.0:1789518102.927891:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518102.928054:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616942080 00000100:00100000:1.0:1789518102.928059:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616942080 00000100:00100000:1.0:1789518102.928097:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 208 00000100:00100000:1.0:1789518102.928105:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+13:2345:x1876445616942080:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518102.928148:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+13:2345:x1876445616942080:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 44us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518102.928155:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 208 00000100:00100000:0.0:1789518102.928328:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616942464 00000100:00100000:0.0:1789518102.928333:0:6649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616942464 00000100:00100000:0.0:1789518102.928378:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616942592 00000100:00100000:0.0:1789518102.928381:0:6649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616942592 00000100:00100000:0.0:1789518102.928405:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:0.0:1789518102.928411:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2345:x1876445616942464:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518102.928440:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2345:x1876445616942464:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 29us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518102.928452:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:0.0:1789518102.928464:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:0.0:1789518102.928470:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2345:x1876445616942592:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518102.928493:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2345:x1876445616942592:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 24us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518102.928499:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00080000:3.0:1789518102.928676:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789518102.928680:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789518102.963692:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518103.155046:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff6f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627454464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518103.155108:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518103.155189:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627454464 00000100:00100000:3.0:1789518103.155197:0:6651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627454464 00000100:00080000:2.0:1789518103.155264:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518103.155273:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789518103.155283:0:6651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627454464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789518103.155315:0:6651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789518103.155368:0:6651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627454464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518103.155376:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1789518103.155578:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffff6f4700 x1876445627454464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518119 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518103.155597:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff6f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627454464:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789518103.986872:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518105.011648:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518106.034758:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518106.226772:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627454720:0@lo:400:kworker.0 00000100:00100000:3.0:1789518106.226838:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518106.226882:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627455232:0@lo:400:kworker.0 00000100:00100000:3.0:1789518106.226910:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518106.227013:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:824c8f07-28fa-48fd-81af-173b194570e6:3282:1876445627454592:0@lo:400:kworker.0 00000100:00100000:0.0:1789518106.227049:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518106.227074:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627455104:0@lo:400:kworker.0 00000100:00100000:0.0:1789518106.227099:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518106.227147:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627455232 00000100:00100000:3.0:1789518106.227163:0:6649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627455232 00000100:00100000:3.0:1789518106.227282:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789518106.227291:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627455232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518106.227361:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627455232:12345-0@lo:400:kworker.0 Request processed in 66us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518106.227369:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789518106.227390:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627454592 00000100:00100000:3.0:1789518106.227393:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627454592 00000100:00100000:3.0:1789518106.227417:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789518106.227423:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+19:3282:x1876445627454592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518106.227451:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+19:3282:x1876445627454592:12345-0@lo:400:kworker.0 Request processed in 28us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518106.227456:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00080000:3.0:1789518106.227485:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789518106.227911:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fff4979500 x1876445627455232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518106.227923:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627455232:0@lo:400:kworker.0 00000100:00100000:1.0:1789518106.228058:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627454720 00000100:00100000:1.0:1789518106.228062:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627454720 00000100:00100000:1.0:1789518106.228089:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627455104 00000100:00100000:1.0:1789518106.228091:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627455104 00000100:00100000:1.0:1789518106.228113:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789518106.228119:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff497a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627454720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518106.228173:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff497a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627454720:12345-0@lo:400:kworker.0 Request processed in 53us (1335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518106.228179:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789518106.228192:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789518106.228197:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876445627455104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518106.228238:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876445627455104:12345-0@lo:400:kworker.0 Request processed in 41us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518106.228244:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789518106.228263:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff497b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627454976:0@lo:400:kworker.0 00000100:00100000:1.0:1789518106.228288:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518106.228307:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789518106.228313:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff497b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627454848:0@lo:400:kworker.0 00000100:00100000:1.0:1789518106.228350:0:6647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627454976 00000100:00100000:1.0:1789518106.228354:0:6647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627454976 00000100:00080000:2.0:1789518106.228367:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789518106.228371:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518106.228384:0:6647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789518106.228390:0:6647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff6f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627454976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518106.228393:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627454720:0@lo:400:kworker.0 00000100:00100000:1.0:1789518106.228430:0:6647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff6f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627454976:12345-0@lo:400:kworker.0 Request processed in 40us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518106.228436:0:6647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789518106.229414:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518106.229450:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627455360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518106.229481:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789518106.229512:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fff497b100 x1876445627454976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518106.229523:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff497b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627454976:0@lo:400:kworker.0 00000100:00100000:1.0:1789518106.229546:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627455360 00000100:00100000:1.0:1789518106.229550:0:6652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627455360 00000100:00100000:1.0:1789518106.229579:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789518106.229587:0:6652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff6f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627455360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789518106.229638:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789518106.229680:0:6652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff6f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627455360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518106.229685:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1789518106.229853:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffeda7a300 x1876445627455360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518122 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518106.229920:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627455104:0@lo:400:kworker.0 00000100:00100000:0.0:1789518106.229939:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:824c8f07-28fa-48fd-81af-173b194570e6:3282:1876445627454592:0@lo:400:kworker.0 00000100:00100000:3.0:1789518106.230004:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627454848 00000100:00100000:3.0:1789518106.230009:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627454848 00000100:00100000:3.0:1789518106.230091:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789518106.230098:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff6f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627454848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518106.230132:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff6f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627454848:12345-0@lo:400:kworker.0 Request processed in 35us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518106.230138:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789518106.230196:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627455360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518106.230320:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff497b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627454848:0@lo:400:kworker.0 00000100:00080000:0.0:1789518106.230379:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789518107.058883:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789518107.398564:0:10973:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1789518108.044950:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518108.045180:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616942720 00000100:00100000:0.0:1789518108.045189:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616942720 00000100:00100000:0.0:1789518108.045246:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 210 00000100:00100000:0.0:1789518108.045256:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+13:2342:x1876445616942720:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518108.045333:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+13:2342:x1876445616942720:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 79us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518108.045341:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 210 00000100:00100000:0.0:1789518108.046052:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518108.046286:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518108.046505:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616942848 00000100:00100000:1.0:1789518108.046521:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616942848 00000100:00100000:1.0:1789518108.046574:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616942976 00000100:00100000:1.0:1789518108.046584:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616942976 00000100:00100000:1.0:1789518108.046629:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:1.0:1789518108.046638:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2342:x1876445616942848:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518108.046684:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2342:x1876445616942848:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 47us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518108.046690:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:1.0:1789518108.046706:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:1.0:1789518108.046713:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2342:x1876445616942976:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518108.046735:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2342:x1876445616942976:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 24us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518108.046741:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00080000:0.0:1789518108.048764:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518108.051037:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518108.051104:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616943104 00000100:00100000:1.0:1789518108.051113:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518108.051114:0:6649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616943104 00000100:00100000:3.0:1789518108.051191:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616943232 00000100:00100000:3.0:1789518108.051194:0:6649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616943232 00000100:00100000:1.0:1789518108.051216:0:6647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:3.0:1789518108.051225:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:1.0:1789518108.051230:0:6647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff6f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2342:x1876445616943104:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518108.051238:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff6f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2342:x1876445616943232:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518108.051300:0:6647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff6f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2342:x1876445616943104:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 75us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518108.051306:0:6647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:3.0:1789518108.054236:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff6f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2342:x1876445616943232:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 2995us (3116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518108.054248:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00080000:3.0:1789518108.054286:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789518108.054292:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789518108.083190:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518108.275053:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627455488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518108.275178:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518108.275266:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627455488 00000100:00100000:0.0:1789518108.275274:0:6652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627455488 00000100:00100000:0.0:1789518108.275339:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789518108.275349:0:6652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627455488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518108.275379:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789518108.275425:0:6652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627455488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518108.275432:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1789518108.275468:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffeda78380 x1876445627455488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518124 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518108.275485:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627455488:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789518108.275745:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789518109.106993:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789518109.302798:0:11120:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd6a2c72b0 20000000:00000080:3.0:1789518109.302815:0:11120:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99fff497fc00 uarg=0000000000000000 20000000:01000000:3.0:1789518109.302854:0:11120:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789518109.302859:0:11120:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789518109.302864:0:11120:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789518109.304012:0:11121:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1789518109.304127:0:11120:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789518109.311437:0:11120:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789518109.311465:0:11120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ffc6b17200/0x631fd8698c780d19 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518109.311484:0:11120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffc6b16800/0x631fd8698c780c5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc64f expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518109.311493:0:11120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffc29c9400/0x631fd8698c780c86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780c7f expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518109.311500:0:11120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffc6b17800/0x631fd8698c780cb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780ca9 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518109.311507:0:11120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffc29e0000/0x631fd8698c780cda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780cd3 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518109.311514:0:11120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99fffc28d000/0x631fd8698c780cfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc687 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518109.311521:0:11120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ffc6b17200/0x631fd8698c780d19 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518109.311557:0:11120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99fffc28d000/0x631fd8698c780cfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc687 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518109.311571:0:11120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99fffc28d000/0x631fd8698c780cfd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc687 expref: 12 pid: 5807 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518109.311597:0:11120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4979500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11120:1876445627455616:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518109.311841:0:11120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffc29e0000/0x631fd8698c780cda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c780cd3 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518109.311850:0:11120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffc29e0000/0x631fd8698c780cda lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c780cd3 expref: 18 pid: 5806 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518109.311859:0:11120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4978a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11120:1876445627455744:0@lo:104: 00000100:00100000:3.0:1789518109.311894:0:11120:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789518109.311931:0:11120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffc6b17800/0x631fd8698c780cb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c780ca9 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518109.311939:0:11120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffc6b17800/0x631fd8698c780cb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c780ca9 expref: 18 pid: 5805 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518109.311947:0:11120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4978000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11120:1876445627455872:0@lo:104: 00000100:00100000:3.0:1789518109.311966:0:11120:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789518109.311983:0:11120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffc29c9400/0x631fd8698c780c86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c780c7f expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518109.311990:0:11120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffc29c9400/0x631fd8698c780c86 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c780c7f expref: 18 pid: 5807 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518109.311998:0:11120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff497b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11120:1876445627456000:0@lo:104: 00000100:00100000:3.0:1789518109.312012:0:11120:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789518109.312027:0:11120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffc6b16800/0x631fd8698c780c5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc64f expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518109.312044:0:11120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ffc6b16800/0x631fd8698c780c5c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc64f expref: 12 pid: 5807 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518109.312053:0:11120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff497a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11120:1876445627456128:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518109.312074:0:11120:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab3600 going to sleep for 11 seconds 00000100:00100000:1.0:1789518109.312081:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627455744 00000100:00100000:3.0:1789518109.312106:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627455872 00000100:00100000:3.0:1789518109.312111:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627455872 00000100:00100000:3.0:1789518109.312152:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627456000 00000100:00100000:3.0:1789518109.312155:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627456000 00000100:00100000:3.0:1789518109.312169:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789518109.312177:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4979f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:824c8f07-28fa-48fd-81af-173b194570e6+4:11120:x1876445627455872:12345-0@lo:104: 00010000:00010000:3.0:1789518109.312189:0:8412:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1800/0x631fd8698c780ca9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780cb0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518109.312235:0:8412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789518109.312241:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4979f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:824c8f07-28fa-48fd-81af-173b194570e6+4:11120:x1876445627455872:12345-0@lo:104: Request processed in 65us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518109.312248:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789518109.312264:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789518109.312270:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4979180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:824c8f07-28fa-48fd-81af-173b194570e6+3:11120:x1876445627456000:12345-0@lo:104: 00010000:00010000:3.0:1789518109.312277:0:8412:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0200/0x631fd8698c780c7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780c86 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518109.312309:0:8412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789518109.312314:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4979180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:824c8f07-28fa-48fd-81af-173b194570e6+3:11120:x1876445627456000:12345-0@lo:104: Request processed in 45us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518109.312319:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1789518109.312340:0:7595:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789518109.312346:0:7595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1800/0x631fd8698c780ca9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780cb0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518109.312353:0:7595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1800 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:3.0:1789518109.312357:0:7595:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1800/0x631fd8698c780ca9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c780cb0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518109.312364:0:7595:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1800/0x631fd8698c780ca9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c780cb0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518109.312370:0:7595:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1800/0x631fd8698c780ca9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c780cb0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518109.312388:0:7595:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789518109.312414:0:7595:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1800/0x631fd8698c780ca9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780cb0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518109.312420:0:7595:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518109.312436:0:7595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1800/0x631fd8698c780ca9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780cb0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518109.312441:0:7595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1800/0x631fd8698c780ca9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780cb0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518109.312450:0:7595:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518109.312452:0:7595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0200/0x631fd8698c780c7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780c86 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518109.312455:0:7595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0200 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:3.0:1789518109.312457:0:7595:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0200/0x631fd8698c780c7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c780c86 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518109.312466:0:7595:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0200/0x631fd8698c780c7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c780c86 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518109.312470:0:7595:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0200/0x631fd8698c780c7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c780c86 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518109.312473:0:7595:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789518109.312482:0:7595:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0200/0x631fd8698c780c7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780c86 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518109.312485:0:7595:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518109.312489:0:7595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0200/0x631fd8698c780c7f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780c86 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518109.312492:0:7595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0200/0x631fd8698c780c7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780c86 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518109.312498:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518109.312499:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518109.312500:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518109.312520:0:11120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4978000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11120:1876445627455872:0@lo:104: 00000100:00100000:3.0:1789518109.312524:0:11120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff497b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11120:1876445627456000:0@lo:104: 00000100:00100000:3.0:1789518109.312539:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:824c8f07-28fa-48fd-81af-173b194570e6:3283:1876445627456384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518109.312561:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518109.312574:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789518109.312578:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff497b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:824c8f07-28fa-48fd-81af-173b194570e6:3283:1876445627456256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518109.312589:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789518109.312632:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518109.312805:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627456384 00000100:00100000:0.0:1789518109.312810:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627456384 00010000:00010000:0.0:1789518109.312827:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffc29c9400/0x631fd8698c780c86 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780c7f expref: 19 pid: 5807 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518109.312853:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627456256 00000100:00100000:0.0:1789518109.312855:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627456256 00010000:00010000:0.0:1789518109.312865:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffc6b17800/0x631fd8698c780cb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780ca9 expref: 20 pid: 5805 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518109.312883:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789518109.312888:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627455744 00000100:00100000:0.0:1789518109.312889:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd8064850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:824c8f07-28fa-48fd-81af-173b194570e6+20:3283:x1876445627456384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789518109.312901:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518109.312906:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffc29c9400/0x631fd8698c780c86 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780c7f expref: 20 pid: 5807 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518109.312925:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffc29c9400/0x631fd8698c780c86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c780c7f expref: 20 pid: 5807 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518109.312928:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789518109.312941:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff497b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:824c8f07-28fa-48fd-81af-173b194570e6+3:11120:x1876445627455744:12345-0@lo:104: 00010000:00010000:0.0:1789518109.312945:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc29c9400/0x631fd8698c780c86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c780c7f expref: 20 pid: 5807 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518109.312952:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1000/0x631fd8698c780cd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780cda expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518109.312963:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518109.313010:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd8064850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:824c8f07-28fa-48fd-81af-173b194570e6+19:3283:x1876445627456384:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518109.313017:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789518109.313052:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789518109.313058:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff497aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:824c8f07-28fa-48fd-81af-173b194570e6+18:3283:x1876445627456256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789518109.313066:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518109.313072:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffc6b17800/0x631fd8698c780cb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780ca9 expref: 18 pid: 5805 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518109.313082:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffc6b17800/0x631fd8698c780cb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c780ca9 expref: 18 pid: 5805 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518109.313092:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1789518109.313093:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b17800/0x631fd8698c780cb0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c780ca9 expref: 18 pid: 5805 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518109.313102:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff497b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:824c8f07-28fa-48fd-81af-173b194570e6+3:11120:x1876445627455744:12345-0@lo:104: Request processed in 163us (1205us total) trans 0 rc 0/0 00010000:00010000:0.0:1789518109.313106:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518109.313112:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789518109.313147:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff497aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:824c8f07-28fa-48fd-81af-173b194570e6+17:3283:x1876445627456256:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (555us total) trans 0 rc 0/0 00010000:00010000:1.0:1789518109.313148:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518109.313154:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1000/0x631fd8698c780cd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780cda expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518109.313159:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1789518109.313166:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1000 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:1.0:1789518109.313170:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1000/0x631fd8698c780cd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c780cda expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518109.313178:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1000/0x631fd8698c780cd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c780cda expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518109.313185:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1000/0x631fd8698c780cd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c780cda expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518109.313190:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789518109.313215:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1000/0x631fd8698c780cd3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780cda expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518109.313221:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789518109.313242:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1000/0x631fd8698c780cd3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780cda expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518109.313249:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1000/0x631fd8698c780cd3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780cda expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518109.313267:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff497b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:824c8f07-28fa-48fd-81af-173b194570e6:3283:1876445627456256:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789518109.313274:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518109.313278:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518109.313280:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:824c8f07-28fa-48fd-81af-173b194570e6:3283:1876445627456384:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789518109.313282:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518109.313473:0:11120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4978a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11120:1876445627455744:0@lo:104: 00000100:00100000:0.0:1789518109.313522:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff6f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:824c8f07-28fa-48fd-81af-173b194570e6:3280:1876445627456512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518109.313549:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518109.314039:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627456512 00000100:00100000:1.0:1789518109.314045:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627456512 00010000:00010000:1.0:1789518109.314066:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffc29e0000/0x631fd8698c780cda lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780cd3 expref: 17 pid: 5806 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518109.314090:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789518109.314098:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0790700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:824c8f07-28fa-48fd-81af-173b194570e6+17:3280:x1876445627456512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789518109.314108:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518109.314113:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffc29e0000/0x631fd8698c780cda lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780cd3 expref: 17 pid: 5806 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518109.314122:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffc29e0000/0x631fd8698c780cda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c780cd3 expref: 17 pid: 5806 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518109.314142:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc29e0000/0x631fd8698c780cda lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c780cd3 expref: 17 pid: 5806 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518109.314153:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518109.314194:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0790700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:824c8f07-28fa-48fd-81af-173b194570e6+16:3280:x1876445627456512:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518109.314201:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789518109.314311:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff6f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:824c8f07-28fa-48fd-81af-173b194570e6:3280:1876445627456512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518109.316263:0:11120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4979500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11120:1876445627455616:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518109.316274:0:11120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff497a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11120:1876445627456128:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518109.316302:0:11120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ffc6b17200/0x631fd8698c780d19 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518109.317230:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518109.317372:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616943360 00000100:00100000:0.0:1789518109.317380:0:5798:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616943360 00010000:00010000:0.0:1789518109.317410:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99fffc28d000/0x631fd8698c780cfd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc687 expref: 13 pid: 5807 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518109.317440:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:0.0:1789518109.317446:0:5798:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff6f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e55716f-fc49-42ce-abad-050985078c82+13:2343:x1876445616943360:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518109.317455:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518109.317459:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99fffc28d000/0x631fd8698c780cfd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc687 expref: 13 pid: 5807 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518109.317466:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99fffc28d000/0x631fd8698c780cfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc687 expref: 13 pid: 5807 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518109.317478:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc28d000/0x631fd8698c780cfd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc687 expref: 13 pid: 5807 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518109.317487:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518109.317534:0:5798:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff6f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e55716f-fc49-42ce-abad-050985078c82+12:2343:x1876445616943360:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 87us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518109.317542:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:1.0:1789518109.318879:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518109.318917:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616943488 00000100:00100000:0.0:1789518109.318924:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616943488 00010000:00010000:0.0:1789518109.318956:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffc6b16800/0x631fd8698c780c5c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc64f expref: 12 pid: 5807 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518109.318985:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:0.0:1789518109.318995:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff6f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e55716f-fc49-42ce-abad-050985078c82+12:2342:x1876445616943488:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518109.319017:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518109.319023:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffc6b16800/0x631fd8698c780c5c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc64f expref: 12 pid: 5807 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518109.319032:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffc6b16800/0x631fd8698c780c5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc64f expref: 12 pid: 5807 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518109.319043:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b16800/0x631fd8698c780c5c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc64f expref: 12 pid: 5807 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518109.319056:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ffc6b17200/0x631fd8698c780d19 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518109.319064:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc6b17200/0x631fd8698c780d19 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518109.319078:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffc6b17200/0x631fd8698c780d19 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518109.319085:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffc6b17200/0x631fd8698c780d19 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518109.319092:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ffc6b17200/0x631fd8698c780d19 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518109.319099:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ffc6b17200/0x631fd8698c780d19 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518109.319104:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518109.319108:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ffc6b17200/0x631fd8698c780d19 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518109.319127:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ffc6b17200/0x631fd8698c780d19 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518109.319166:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ffc6b17200/0x631fd8698c780d19 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518109.319177:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518109.319206:0:11120:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ffc6b17200/0x631fd8698c780d19 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518109.319218:0:11120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ffc6b17200/0x631fd8698c780d19 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518109.319225:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff6f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e55716f-fc49-42ce-abad-050985078c82+11:2342:x1876445616943488:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 230us (348us total) trans 0 rc 0/0 00010000:00010000:3.0:1789518109.319228:0:11120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b17200/0x631fd8698c780d19 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518109.319240:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 29 00010000:00010000:3.0:1789518110.132746:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789518110.582232:0:5810:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789518110.582239:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ffff791800 from 7 10000000:01000000:0.0:1789518110.582255:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789518110.582298:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc28de00/0x631fd8698c780d20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518110.582309:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fffc28de00/0x631fd8698c780d20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518110.582321:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fffc28de00/0x631fd8698c780d20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518110.582348:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0790e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627456640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789518110.582411:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518110.582451:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7ac0540 going to sleep for 11 seconds 00000100:00100000:3.0:1789518110.582656:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627456640 00000100:00100000:3.0:1789518110.582664:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627456640 00000100:00100000:3.0:1789518110.582711:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1789518110.582719:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+16:5810:x1876445627456640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518110.582731:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518110.582743:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc6b17200/0x631fd8698c780d27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780d20 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518110.582765:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc6b17200/0x631fd8698c780d27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780d20 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518110.582890:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc6b17200/0x631fd8698c780d27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780d20 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518110.582909:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17200, rc 0) 00000100:00100000:3.0:1789518110.582956:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+17:5810:x1876445627456640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 237us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518110.582963:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1789518110.583039:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0790e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627456640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518110.583055:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fffc28de00/0x631fd8698c780d20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780d27 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518110.583073:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fffc28de00/0x631fd8698c780d20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780d27 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518110.583141:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0790e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627456768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518110.583167:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518110.583194:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7ac0540 going to sleep for 11 seconds 00000100:00100000:3.0:1789518110.583235:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627456768 00000100:00100000:3.0:1789518110.583240:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627456768 00000100:00100000:3.0:1789518110.583337:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789518110.583344:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+17:5810:x1876445627456768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518110.583550:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+17:5810:x1876445627456768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 205us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518110.583557:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1789518110.583648:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0790e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627456768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518110.583675:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0790e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627456896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518110.583712:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518110.583733:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7ac0540 going to sleep for 11 seconds 00000100:00100000:3.0:1789518110.583843:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627456896 00000100:00100000:3.0:1789518110.583848:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627456896 00000100:00100000:3.0:1789518110.583969:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789518110.583977:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+17:5810:x1876445627456896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789518110.584114:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+17:5810:x1876445627456896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518110.584121:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1789518110.584197:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0790e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627456896:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789518110.584824:0:11204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789518110.584904:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789518110.584920:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789518110.584928:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc28de00/0x631fd8698c780d20 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780d27 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518110.584938:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fffc28de00/0x631fd8698c780d20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780d27 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518110.584947:0:5810:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789518110.584949:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ffc76f3000 from 7 10000000:01000000:1.0:1789518110.584952:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789518110.584974:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc0031800/0x631fd8698c780d2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518110.584981:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffc0031800/0x631fd8698c780d2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518110.584989:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc0031800/0x631fd8698c780d2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518110.585003:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff6f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627457024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789518110.585033:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518110.585519:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd811d600 going to sleep for 11 seconds 00000100:00100000:0.0:1789518110.585643:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627457024 00000100:00100000:0.0:1789518110.585648:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627457024 00000100:00100000:0.0:1789518110.585674:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1789518110.585680:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+17:5810:x1876445627457024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518110.585689:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518110.585700:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc28c600/0x631fd8698c780d35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780d2e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518110.585719:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc28c600/0x631fd8698c780d35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780d2e expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518110.585728:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc28c600/0x631fd8698c780d35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780d2e expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518110.585736:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28c600, rc 0) 00000100:00100000:0.0:1789518110.585787:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+18:5810:x1876445627457024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518110.585800:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789518110.585972:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff6f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627457024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518110.585987:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc0031800/0x631fd8698c780d2e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780d35 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518110.585996:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc0031800/0x631fd8698c780d2e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780d35 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518110.586046:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff6f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627457152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518110.586071:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518110.586140:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd811d600 going to sleep for 11 seconds 00000100:00100000:0.0:1789518110.586176:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627457152 00000100:00100000:0.0:1789518110.586180:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627457152 00000100:00100000:0.0:1789518110.586242:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789518110.586259:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+18:5810:x1876445627457152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518110.586449:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+18:5810:x1876445627457152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 200us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518110.586456:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1789518110.586512:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff6f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627457152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518110.586538:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff6f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627457280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518110.586574:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518110.586869:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd811d600 going to sleep for 11 seconds 00000100:00100000:3.0:1789518110.586907:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627457280 00000100:00100000:3.0:1789518110.586912:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627457280 00000100:00100000:3.0:1789518110.586935:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1789518110.586941:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+18:5810:x1876445627457280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789518110.587071:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+18:5810:x1876445627457280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518110.587078:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1789518110.589307:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff6f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627457280:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789518110.590377:0:11207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789518110.590433:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789518110.590450:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789518110.590460:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc0031800/0x631fd8698c780d2e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780d35 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518110.590471:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc0031800/0x631fd8698c780d2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780d35 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518110.590481:0:5810:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789518110.590483:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ffc84db000 from 7 10000000:01000000:0.0:1789518110.590486:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789518110.590516:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc28d400/0x631fd8698c780d3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518110.590524:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fffc28d400/0x631fd8698c780d3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518110.590533:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fffc28d400/0x631fd8698c780d3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518110.590564:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0791500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627457408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789518110.590639:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518110.590676:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7ac0180 going to sleep for 11 seconds 00000100:00100000:3.0:1789518110.591021:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627457408 00000100:00100000:3.0:1789518110.591028:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627457408 00000100:00100000:3.0:1789518110.591072:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789518110.591081:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+18:5810:x1876445627457408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518110.591092:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518110.591103:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc6b16400/0x631fd8698c780d43 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780d3c expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518110.591124:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc6b16400/0x631fd8698c780d43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780d3c expref: 19 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518110.591147:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc6b16400/0x631fd8698c780d43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780d3c expref: 19 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518110.591155:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16400, rc 0) 00000100:00100000:3.0:1789518110.591192:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+19:5810:x1876445627457408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518110.591198:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789518110.591665:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0791500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627457408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518110.591681:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fffc28d400/0x631fd8698c780d3c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780d43 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518110.591691:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fffc28d400/0x631fd8698c780d3c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780d43 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518110.591744:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0791500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627457536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518110.591772:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518110.591869:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7ac0180 going to sleep for 11 seconds 00000100:00100000:3.0:1789518110.591927:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627457536 00000100:00100000:3.0:1789518110.591933:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627457536 00000100:00100000:3.0:1789518110.591998:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789518110.592005:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+19:5810:x1876445627457536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518110.592259:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+19:5810:x1876445627457536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 243us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518110.592267:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789518110.592429:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0791500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627457536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518110.592461:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0791500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627457664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518110.592500:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518110.592521:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7ac0180 going to sleep for 11 seconds 00000100:00100000:3.0:1789518110.592553:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627457664 00000100:00100000:3.0:1789518110.592558:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627457664 00000100:00100000:3.0:1789518110.592574:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789518110.592579:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+19:5810:x1876445627457664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789518110.593350:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+19:5810:x1876445627457664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 768us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518110.593358:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789518110.593894:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0791500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627457664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789518110.595729:0:11209:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789518110.597396:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789518110.597427:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789518110.597438:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc28d400/0x631fd8698c780d3c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780d43 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518110.597464:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fffc28d400/0x631fd8698c780d3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780d43 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518111.154743:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518111.309121:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518111.309301:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616943616 00000100:00100000:3.0:1789518111.309311:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616943616 00000100:00100000:3.0:1789518111.309367:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 220 00000100:00100000:3.0:1789518111.309384:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+11:5579:x1876445616943616:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518111.309399:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518111.309417:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc6b16c00/0x631fd8698c780d4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc6b1 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518111.309446:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc6b16c00/0x631fd8698c780d4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6b1 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518111.309456:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc6b16c00/0x631fd8698c780d4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6b1 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518111.309466:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16c00, rc 0) 00000100:00100000:3.0:1789518111.309515:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+12:5579:x1876445616943616:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 139us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518111.309523:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 220 00000100:00100000:1.0:1789518111.312267:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518111.312348:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616943744 00000100:00100000:3.0:1789518111.312357:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616943744 00000100:00100000:3.0:1789518111.312405:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 221 00000100:00100000:3.0:1789518111.312415:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+12:5579:x1876445616943744:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518111.312741:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+12:5579:x1876445616943744:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 326us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518111.312759:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 221 00000100:00100000:0.0:1789518111.315750:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518111.315985:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616943872 00000100:00100000:1.0:1789518111.315994:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616943872 00000100:00100000:1.0:1789518111.316173:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 222 00000100:00100000:1.0:1789518111.316184:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+12:5579:x1876445616943872:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518111.316377:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+12:5579:x1876445616943872:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 194us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518111.316385:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 222 00000100:00100000:0.0:1789518111.322076:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518111.322188:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616944000 00000100:00100000:1.0:1789518111.322198:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616944000 00000100:00100000:1.0:1789518111.322254:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 223 00000100:00100000:1.0:1789518111.322265:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+12:5579:x1876445616944000:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518111.322281:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518111.322298:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780d51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc6b8 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518111.322325:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780d51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6b8 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518111.322344:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780d51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6b8 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518111.322354:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc0030a00, rc 0) 00000100:00100000:1.0:1789518111.322406:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+13:5579:x1876445616944000:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 142us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518111.322414:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 223 00000100:00100000:3.0:1789518111.323859:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518111.333060:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616944128 00000100:00100000:1.0:1789518111.333075:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616944128 00000100:00100000:1.0:1789518111.333152:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 224 00000100:00100000:1.0:1789518111.333162:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+13:5579:x1876445616944128:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518111.333422:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+13:5579:x1876445616944128:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 259us (9566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518111.333430:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 224 00000100:00100000:1.0:1789518111.336212:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518111.336290:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616944256 00000100:00100000:2.0:1789518111.336301:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616944256 00000100:00100000:2.0:1789518111.336352:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 225 00000100:00100000:2.0:1789518111.336362:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+13:5579:x1876445616944256:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789518111.336594:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+13:5579:x1876445616944256:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 232us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518111.336634:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 225 00000100:00100000:3.0:1789518111.348396:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff497b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627458176:0@lo:400:kworker.0 00000100:00100000:3.0:1789518111.348455:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518111.348501:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789518111.348507:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff497a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:824c8f07-28fa-48fd-81af-173b194570e6:3280:1876445627457792:0@lo:400:kworker.0 00000100:00100000:3.0:1789518111.348532:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518111.348550:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627458304:0@lo:400:kworker.0 00000100:00100000:3.0:1789518111.348586:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518111.348634:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627457920:0@lo:400:kworker.0 00000100:00100000:3.0:1789518111.348660:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518111.349668:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627458432:0@lo:400:kworker.0 00000100:00100000:3.0:1789518111.349909:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518111.349936:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789518111.349943:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627458048:0@lo:400:kworker.0 00000100:00100000:3.0:1789518111.349971:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518111.350007:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627458304 00000100:00100000:3.0:1789518111.350274:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627458304 00000100:00100000:3.0:1789518111.350325:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627457920 00000100:00100000:3.0:1789518111.350329:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627457920 00000100:00100000:3.0:1789518111.350341:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627458048 00000100:00100000:3.0:1789518111.350343:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627458048 00000100:00100000:3.0:1789518111.350357:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789518111.350365:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627458304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518111.350420:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627458304:12345-0@lo:400:kworker.0 Request processed in 55us (1833us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518111.350420:0:6647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627458176 00000100:00100000:1.0:1789518111.350426:0:6647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627458176 00000100:00100000:3.0:1789518111.350437:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789518111.350458:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789518111.350462:0:6647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627458432 00000100:00100000:1.0:1789518111.350466:0:6647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627458432 00000100:00100000:3.0:1789518111.350467:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627457920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518111.350489:0:6647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789518111.350499:0:6647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff497b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627458176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518111.350511:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627457920:12345-0@lo:400:kworker.0 Request processed in 46us (1850us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518111.350518:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789518111.350533:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789518111.350541:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627458048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518111.350548:0:6647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff497b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627458176:12345-0@lo:400:kworker.0 Request processed in 48us (2090us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518111.350557:0:6647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789518111.350576:0:6647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789518111.350581:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627458048:12345-0@lo:400:kworker.0 Request processed in 40us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518111.350589:0:6647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627458432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518111.350592:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789518111.350651:0:6647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627458432:12345-0@lo:400:kworker.0 Request processed in 65us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518111.350658:0:6647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789518111.350711:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff6f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627458560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518111.350736:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518111.350765:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627458560 00000100:00100000:1.0:1789518111.350769:0:6652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627458560 00000100:00100000:1.0:1789518111.350797:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789518111.350804:0:6652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff6f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627458560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789518111.350832:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789518111.350872:0:6652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff6f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627458560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518111.350877:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1789518111.350911:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffff6f5c00 x1876445627458560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518127 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518111.350927:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff6f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627458560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518111.350949:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627457792 00000100:00100000:1.0:1789518111.350952:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627457792 00000100:00100000:1.0:1789518111.350976:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789518111.350983:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+19:3280:x1876445627457792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518111.351012:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+19:3280:x1876445627457792:12345-0@lo:400:kworker.0 Request processed in 30us (2480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518111.351019:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00080000:3.0:1789518111.351250:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789518111.351255:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789518111.351257:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518111.351277:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff497a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:824c8f07-28fa-48fd-81af-173b194570e6:3280:1876445627457792:0@lo:400:kworker.0 00000100:00100000:3.0:1789518111.351289:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627458304:0@lo:400:kworker.0 00010000:00080000:3.0:1789518111.351299:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fff497b100 x1876445627458176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518111.351308:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff497b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627458176:0@lo:400:kworker.0 00000100:00100000:3.0:1789518111.351334:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627458048:0@lo:400:kworker.0 00000100:00100000:3.0:1789518111.351343:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627457920:0@lo:400:kworker.0 00010000:00080000:3.0:1789518111.351351:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fff4979c00 x1876445627458432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518111.351371:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627458432:0@lo:400:kworker.0 00000001:02000400:2.0:1789518111.713914:0:11317:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789518112.180044:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518113.168251:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518113.168301:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518113.168338:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518113.168374:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518113.168405:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518113.168434:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616944640 00000100:00100000:0.0:1789518113.168444:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616944640 00000100:00100000:3.0:1789518113.168451:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616944512 00000100:00100000:3.0:1789518113.168458:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616944512 00000100:00100000:2.0:1789518113.168464:0:8784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616944896 00000100:00100000:2.0:1789518113.168470:0:8784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616944896 00000100:00100000:0.0:1789518113.168509:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 52 00000100:00100000:2.0:1789518113.168518:0:8784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616944768 00000100:00100000:2.0:1789518113.168524:0:8784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616944768 00000100:00100000:0.0:1789518113.168525:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2343:x1876445616944640:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518113.168533:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 53 00000100:00100000:2.0:1789518113.168548:0:8784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:3.0:1789518113.168556:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2343:x1876445616944512:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518113.168562:0:8784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2343:x1876445616944896:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518113.168605:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2343:x1876445616944512:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 57us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518113.168605:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2343:x1876445616944640:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 81us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518113.168641:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616944384 00000100:00100000:3.0:1789518113.168651:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 53 00000100:00100000:1.0:1789518113.168671:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616944384 00000100:00100000:3.0:1789518113.168694:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:3.0:1789518113.168705:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2343:x1876445616944768:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518113.168827:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 227 00000100:00100000:1.0:1789518113.168839:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+13:2343:x1876445616944384:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518113.169384:0:8784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2343:x1876445616944896:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 825us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518113.169393:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2343:x1876445616944768:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 687us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518113.169399:0:8784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:3.0:1789518113.169408:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00080000:2.0:1789518113.169453:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789518113.169458:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789518113.169461:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518113.170195:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+13:2343:x1876445616944384:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 1356us (1950us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518113.170203:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 227 00000100:00100000:0.0:1789518113.170773:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 52 00010000:00010000:1.0:1789518113.203010:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518113.395670:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff6f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627458688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518113.395734:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518113.395798:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627458688 00000100:00100000:3.0:1789518113.395805:0:6652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627458688 00000100:00100000:3.0:1789518113.395853:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789518113.395861:0:6652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627458688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789518113.395894:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789518113.395935:0:6652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627458688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518113.395942:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1789518113.395971:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789518113.396001:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffff6f5c00 x1876445627458688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518129 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518113.396018:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff6f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627458688:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1789518113.869503:0:11417:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 20:21:53 (1789518113) === 00000100:00100000:0.0:1789518113.985019:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518113.985125:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616945024 00000100:00100000:2.0:1789518113.985136:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616945024 00000100:00100000:2.0:1789518113.985188:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:2.0:1789518113.985199:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:9647:x1876445616945024:12345-192.168.206.51@tcp:700:mkdir.0 00000100:00100000:2.0:1789518113.985278:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:9647:x1876445616945024:12345-192.168.206.51@tcp:700:mkdir.0 Request processed in 81us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518113.985285:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:3.0:1789518113.988149:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518113.988226:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616945280 00000100:00100000:0.0:1789518113.988235:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616945280 00000100:00100000:0.0:1789518113.988286:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:0.0:1789518113.988295:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:9647:x1876445616945280:12345-192.168.206.51@tcp:36:mkdir.0 00010000:00010000:0.0:1789518113.988340:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518113.988398:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0a00/0x631fd8698c780c39 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc63a expref: 6 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518113.988429:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2fdc000) 00010000:00010000:0.0:1789518113.988440:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518113.989009:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c780d58 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518113.989021:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c780d58 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518113.989028:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c780d58 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518113.989056:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c780d5f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518113.989065:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c780d5f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518113.989072:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c780d5f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518113.990161:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789518113.990174:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c780d58 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518113.990182:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c780d58 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518113.990189:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c780d58 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518113.990195:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28d000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518113.990207:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c780d58 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518113.990215:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c780d58 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518113.990226:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffd2a17700) 00010000:00010000:0.0:1789518113.990229:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518113.990233:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c780d58 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518113.990239:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c780d58 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518113.990254:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ccf16f60 reply state 000000007c667cf1 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c780d5f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518113.990262:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518113.990426:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:9647:x1876445616945280:12345-192.168.206.51@tcp:36:mkdir.0 Request processed in 2128us (2280us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789518113.990434:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00010000:00010000:1.0:1789518113.993864:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c780d5f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518113.993882:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c780d5f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518113.993890:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c780d5f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518113.993897:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28d200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518113.993901:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c780d5f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518113.993909:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c780d5f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518113.993923:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99ffd2a17900) 00010000:00010000:1.0:1789518113.993926:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518113.993931:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c780d5f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518113.993936:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c780d5f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518114.001286:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518114.001400:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616945408 00000100:00100000:2.0:1789518114.001409:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616945408 00000100:00100000:2.0:1789518114.001462:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:2.0:1789518114.001470:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:9648:x1876445616945408:12345-192.168.206.51@tcp:101:chmod.0 00010000:00010000:2.0:1789518114.001504:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518114.001525:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c780d66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc6bf expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518114.001580:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8800/0x631fd8698c780d6d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518114.001604:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8800/0x631fd8698c780d6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518114.001645:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8800/0x631fd8698c780d6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518114.001684:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789518114.001688:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518114.001947:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8800/0x631fd8698c780d6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518114.001973:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c780d66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6bf expref: 8 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518114.001992:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8800/0x631fd8698c780d6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6bf expref: 7 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518114.002000:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2ad3800) 00010000:00010000:2.0:1789518114.002003:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518114.002006:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29c8800, rc 0) 00000100:00100000:2.0:1789518114.002420:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:9648:x1876445616945408:12345-192.168.206.51@tcp:101:chmod.0 Request processed in 949us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518114.002427:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:3.0:1789518114.004890:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518114.005054:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616945664 00000100:00100000:1.0:1789518114.005063:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616945664 00000100:00100000:0.0:1789518114.005389:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:0.0:1789518114.005403:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:9648:x1876445616945664:12345-192.168.206.51@tcp:36:chmod.0 00010000:00010000:0.0:1789518114.005447:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518114.005472:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8800/0x631fd8698c780d6d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6bf expref: 7 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.005490:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2ad3800) 00010000:00010000:0.0:1789518114.005499:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518114.005519:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c780d74 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.005540:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c780d74 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.005549:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c780d74 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518114.006770:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000026a5839e reply state 000000002771ba19 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c780d74 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518114.006846:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789518114.006856:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789518114.006943:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+8:9648:x1876445616945664:12345-192.168.206.51@tcp:36:chmod.0 Request processed in 1543us (2058us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789518114.006951:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 16 00010000:00010000:1.0:1789518114.008402:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c780d74 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.008417:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c780d74 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.008424:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c780d74 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.008430:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28d000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518114.008434:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c780d74 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.008442:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c780d74 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.008508:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffd2a17700) 00010000:00010000:1.0:1789518114.008512:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789518114.008517:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c780d74 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.008523:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c780d74 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518114.024966:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518114.025047:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616945792 00000100:00100000:0.0:1789518114.025064:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616945792 00000100:00100000:0.0:1789518114.025153:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:0.0:1789518114.025165:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:9649:x1876445616945792:12345-192.168.206.51@tcp:101:chown.0 00010000:00010000:0.0:1789518114.025187:0:8051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518114.025209:0:8051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c780d7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc6c6 expref: -99 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.025279:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c780d82 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.025293:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c780d82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.025306:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c780d82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518114.025352:0:8051:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789518114.025356:0:8051:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518114.025393:0:8051:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c780d82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.025419:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c780d7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6c6 expref: 9 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.025439:0:8051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c780d82 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6c6 expref: 8 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.025447:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffd2a17e00) 00010000:00010000:0.0:1789518114.025450:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789518114.025454:0:8051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28d000, rc 0) 00000100:00100000:0.0:1789518114.025522:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+8:9649:x1876445616945792:12345-192.168.206.51@tcp:101:chown.0 Request processed in 354us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518114.025529:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:3.0:1789518114.027816:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518114.027897:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616945920 00000100:00100000:1.0:1789518114.027909:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616945920 00000100:00100000:1.0:1789518114.027993:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:1.0:1789518114.028004:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+8:9649:x1876445616945920:12345-192.168.206.51@tcp:101:chown.0 00010000:00010000:1.0:1789518114.028035:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518114.028053:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc0030000/0x631fd8698c780d89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc6cd expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.028107:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc0030e00/0x631fd8698c780d90 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.028131:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc0030e00/0x631fd8698c780d90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.028142:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc0030e00/0x631fd8698c780d90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.028170:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c780d97 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.028179:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c780d97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.028186:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c780d97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.028258:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c780d9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.028267:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c780d9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.028274:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c780d9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518114.028300:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789518114.028309:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518114.028329:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c780d9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.028340:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc0030e00/0x631fd8698c780d90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.028347:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc0030e00/0x631fd8698c780d90 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.028354:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc0030e00/0x631fd8698c780d90 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.028360:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc0030e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518114.028364:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc0030e00/0x631fd8698c780d90 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.028371:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc0030e00/0x631fd8698c780d90 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.028381:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffd2a17e00) 00010000:00010000:1.0:1789518114.028384:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518114.028388:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc0030e00/0x631fd8698c780d90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.028394:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc0030e00/0x631fd8698c780d90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.028406:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c780d97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.028412:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c780d97 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.028427:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c780d97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.028432:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f6200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518114.028435:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c780d97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.028441:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c780d97 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.028448:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99ffc2fdc900) 00010000:00010000:1.0:1789518114.028450:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518114.028453:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c780d97 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.028459:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c780d97 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.028485:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc0030000/0x631fd8698c780d89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6cd expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.028496:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c780d9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6cd expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.028503:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99ffc2fdc300) 00010000:00010000:1.0:1789518114.028505:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518114.028507:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f7600, rc 0) 00000100:00100000:1.0:1789518114.028567:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+9:9649:x1876445616945920:12345-192.168.206.51@tcp:101:chown.0 Request processed in 564us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518114.028582:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:3.0:1789518114.031260:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518114.031325:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616946176 00000100:00100000:0.0:1789518114.031338:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616946176 00000100:00100000:0.0:1789518114.031441:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:0.0:1789518114.031452:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+9:9649:x1876445616946176:12345-192.168.206.51@tcp:36:chown.0 00010000:00010000:0.0:1789518114.031492:0:8051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518114.031512:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c780d9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6cd expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.031528:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99ffc2fdc300) 00010000:00010000:0.0:1789518114.031549:0:8051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518114.031569:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c780da5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.031580:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c780da5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.031588:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c780da5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789518114.052607:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1789518114.052705:0:8051:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001998a5aa reply state 000000002f0fe75f transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c780da5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518114.052718:0:8051:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789518114.052730:0:8051:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:0.0:1789518114.052822:0:8051:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1789518114.052835:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:9649:x1876445616946176:12345-192.168.206.51@tcp:36:chown.0 Request processed in 21382us (21586us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789518114.052844:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 19 00010000:00010000:1.0:1789518114.053078:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c780da5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.053087:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c780da5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.053094:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c780da5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.053100:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28c200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518114.053105:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c780da5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.053122:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c780da5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.053137:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99ffd2a17600) 00010000:00010000:1.0:1789518114.053140:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789518114.053145:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c780da5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.053151:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c780da5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518114.063281:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518114.063427:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616946304 00000100:00100000:0.0:1789518114.063437:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616946304 00000100:00100000:0.0:1789518114.063494:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:0.0:1789518114.063504:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:9650:x1876445616946304:12345-192.168.206.51@tcp:101:touch.500 00010000:00010000:0.0:1789518114.063526:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518114.063545:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c780dac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc6d4 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789518114.066750:0:5811:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3118us 00010000:00010000:1.0:1789518114.072199:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c780db3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.072222:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c780db3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.072234:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c780db3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.072258:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c780dba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.072266:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c780dba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.072272:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c780dba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.072641:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c780dc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.072651:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c780dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.072658:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c780dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518114.072680:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789518114.072684:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518114.072717:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c780dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.072728:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c780db3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.072735:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c780db3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.072741:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c780db3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.072756:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f6200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518114.072760:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c780db3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.072767:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c780db3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.072778:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffd2a17e00) 00010000:00010000:1.0:1789518114.072781:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518114.072785:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c780db3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.072791:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c780db3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.072802:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c780dba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.072808:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c780dba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.072813:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c780dba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.072818:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f6000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518114.072821:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c780dba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.072827:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c780dba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.072845:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99ffc2fdcd00) 00010000:00010000:1.0:1789518114.072848:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518114.072851:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c780dba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.072857:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c780dba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.072892:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c780dac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6d4 expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.072914:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c780dc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6d4 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.072922:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99ffc2fdc900) 00010000:00010000:1.0:1789518114.072924:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789518114.072926:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f6800, rc 0) 00000100:00100000:1.0:1789518114.072995:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:9650:x1876445616946304:12345-192.168.206.51@tcp:101:touch.500 Request processed in 9491us (9721us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518114.073003:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:3.0:1789518114.078729:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518114.078881:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616946560 00000100:00100000:2.0:1789518114.078890:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616946560 00000100:00100000:2.0:1789518114.078943:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:2.0:1789518114.078954:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:9650:x1876445616946560:12345-192.168.206.51@tcp:101:touch.500 00010000:00010000:2.0:1789518114.078973:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518114.078991:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9800/0x631fd8698c780dc8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc6db expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518114.079216:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c780dcf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518114.079228:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c780dcf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518114.079238:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c780dcf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518114.079270:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8800/0x631fd8698c780dd6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x3642342a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518114.079277:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8800/0x631fd8698c780dd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3642342a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518114.079282:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8800/0x631fd8698c780dd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3642342a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789518114.079886:0:5813:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1789518114.080092:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9400/0x631fd8698c780ddd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518114.080101:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9400/0x631fd8698c780ddd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518114.080191:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9400/0x631fd8698c780ddd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518114.080222:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c780dcf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518114.080228:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c780dcf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518114.080235:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c780dcf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518114.080241:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29c9200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518114.080244:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c780dcf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518114.080252:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c780dcf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518114.080262:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99ffc2fdc900) 00010000:00010000:2.0:1789518114.080265:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518114.080269:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c780dcf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518114.080276:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c780dcf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518114.080290:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000001864521 reply state 00000000e1da4928 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8800/0x631fd8698c780dd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3642342a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518114.080298:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789518114.080327:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9800/0x631fd8698c780dc8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6db expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518114.080340:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9400/0x631fd8698c780ddd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6db expref: 9 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518114.080347:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99ffc2ad3f00) 00010000:00010000:2.0:1789518114.080350:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518114.080352:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29c9400, rc 0) 00000100:00100000:2.0:1789518114.080411:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+10:9650:x1876445616946560:12345-192.168.206.51@tcp:101:touch.500 Request processed in 1459us (1691us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789518114.080417:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:3.0:1789518114.083792:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:1.0:1789518114.084077:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8800/0x631fd8698c780dd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3642342a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.084089:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8800/0x631fd8698c780dd6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3642342a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.084096:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8800/0x631fd8698c780dd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3642342a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.084127:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29c8800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518114.084132:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8800/0x631fd8698c780dd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3642342a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.084140:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8800/0x631fd8698c780dd6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3642342a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.084154:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x3642342a (ffff99ffc2ad3400) 00010000:00010000:1.0:1789518114.084158:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518114.084162:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8800/0x631fd8698c780dd6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3642342a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.084169:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8800/0x631fd8698c780dd6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3642342a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518114.084867:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616946816 00000100:00100000:0.0:1789518114.084878:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616946816 00000100:00100000:0.0:1789518114.084936:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:0.0:1789518114.084945:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+9:9650:x1876445616946816:12345-192.168.206.51@tcp:36:touch.500 00010000:00010000:0.0:1789518114.084990:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518114.085006:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9400/0x631fd8698c780ddd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6db expref: 9 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.085024:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99ffc2ad3f00) 00010000:00010000:0.0:1789518114.085031:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518114.085089:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c780deb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.085101:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c780deb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.085120:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c780deb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518114.085220:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cb3391fb reply state 00000000a46dc03e transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c780deb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518114.085229:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518114.085298:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+10:9650:x1876445616946816:12345-192.168.206.51@tcp:36:touch.500 Request processed in 354us (1513us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789518114.085305:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 22 00010000:00010000:3.0:1789518114.089513:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c780deb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518114.089528:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c780deb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518114.089536:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c780deb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518114.089543:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28da00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518114.089548:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c780deb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518114.089555:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c780deb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518114.089573:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99ffd2a17f00) 00010000:00010000:3.0:1789518114.089584:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518114.089590:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c780deb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518114.089597:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c780deb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518114.089709:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518114.092772:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616946944 00000100:00100000:0.0:1789518114.092786:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616946944 00000100:00100000:0.0:1789518114.092846:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:0.0:1789518114.092855:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff6f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+9:9650:x1876445616946944:12345-192.168.206.51@tcp:101:touch.500 00010000:00010000:0.0:1789518114.092875:0:8051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518114.092904:0:8051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ce00/0x631fd8698c780df2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc6e2 expref: -99 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.092953:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ce00/0x631fd8698c780df2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6e2 expref: 10 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.092965:0:8051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ce00/0x631fd8698c780df2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6e2 expref: 10 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.092981:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99ffd2a17700) 00010000:00010000:0.0:1789518114.092984:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518114.092987:0:8051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28ce00, rc 0) 00000100:00100000:0.0:1789518114.093044:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff6f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+10:9650:x1876445616946944:12345-192.168.206.51@tcp:101:touch.500 Request processed in 190us (3337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518114.093052:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:2.0:1789518114.099068:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518114.099246:0:8784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616947072 00000100:00100000:3.0:1789518114.099254:0:8784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616947072 00000100:00100000:3.0:1789518114.099390:0:8784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:3.0:1789518114.099398:0:8784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2341:x1876445616947072:12345-192.168.206.51@tcp:8:touch.500 00010000:00080000:3.0:1789518114.099427:0:8784:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from cfa1c47d-1425-4fe5-be2a-28ad5152a12d@192.168.206.51@tcp t0 exp 0000000000000000 cur 168 last 0 00000020:00000080:3.0:1789518114.099452:0:8784:0:(genops.c:1384:class_connect()) connect: client cfa1c47d-1425-4fe5-be2a-28ad5152a12d, cookie 0x631fd8698c780df9 00002000:00100000:3.0:1789518114.099463:0:8784:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cfa1c47d-1425-4fe5-be2a-28ad5152a12d/ffff99ffc6bde800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789518114.099482:0:8784:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789518114.099788:0:8784:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789518114.099822:0:8784:0:(import.c:65:import_set_state_nolock()) ffff99ffc6bd9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789518114.099918:0:8784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2341:x1876445616947072:12345-192.168.206.51@tcp:8:touch.500 Request processed in 519us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518114.099926:0:8784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:3.0:1789518114.103092:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518114.103263:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616947200 00000100:00100000:1.0:1789518114.103271:0:6649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616947200 00000100:00080000:3.0:1789518114.103376:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518114.103411:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:1.0:1789518114.103420:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:0:x1876445616947200:12345-192.168.206.51@tcp:2:touch.500 00000001:00080000:0.0:1789518114.141657:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:0.0:1789518114.141675:0:7607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cfa1c47d-1425-4fe5-be2a-28ad5152a12d 00000100:00100000:1.0:1789518114.141819:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:0:x1876445616947200:12345-192.168.206.51@tcp:2:touch.500 Request processed in 38396us (38733us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789518114.141830:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:1.0:1789518114.146890:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518114.147024:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616947456 00000100:00100000:3.0:1789518114.147041:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616947456 00000100:00100000:3.0:1789518114.147130:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:3.0:1789518114.147142:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff6f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+10:9650:x1876445616947456:12345-192.168.206.51@tcp:35:touch.500 00000100:00100000:3.0:1789518114.147565:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff6f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+11:9650:x1876445616947456:12345-192.168.206.51@tcp:35:touch.500 Request processed in 424us (682us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789518114.147590:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:2.0:1789518114.157192:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518114.157300:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616947584 00000100:00100000:1.0:1789518114.157312:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616947584 00000100:00100000:1.0:1789518114.157374:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:1.0:1789518114.157385:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+11:9651:x1876445616947584:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:1.0:1789518114.157430:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518114.157457:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c780e00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc6e9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.157534:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c780e07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.157550:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c780e07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.157564:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c780e07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518114.157604:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789518114.157607:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518114.157784:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c780e07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.157814:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c780e00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6e9 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.157833:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c780e07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6e9 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.157842:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99ffc2fdc900) 00010000:00010000:1.0:1789518114.157845:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518114.157849:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f7800, rc 0) 00000100:00100000:1.0:1789518114.157917:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+12:9651:x1876445616947584:12345-192.168.206.51@tcp:101:rm.0 Request processed in 533us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518114.157925:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:0.0:1789518114.162266:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518114.162400:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616947840 00000100:00100000:2.0:1789518114.162414:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616947840 00000100:00100000:2.0:1789518114.162492:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:2.0:1789518114.162503:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+12:9651:x1876445616947840:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:2.0:1789518114.162528:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518114.162552:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c780e0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc6f0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518114.162844:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789518114.163586:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c780e0e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6f0 expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518114.163604:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffd2a17e00) 00010000:00010000:2.0:1789518114.163607:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789518114.163805:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c780e0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6f0 expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518114.163830:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29c9200, rc 0) 00000100:00100000:3.0:1789518114.164394:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+13:9651:x1876445616947840:12345-192.168.206.51@tcp:101:rm.0 Request processed in 1888us (2138us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1789518114.164404:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:3.0:1789518114.167920:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518114.168024:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616947968 00000100:00100000:0.0:1789518114.168044:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616947968 00000100:00100000:0.0:1789518114.168107:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:0.0:1789518114.168127:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+13:9651:x1876445616947968:12345-192.168.206.51@tcp:37:rm.0 00000100:00100000:0.0:1789518114.172582:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+13:9651:x1876445616947968:12345-192.168.206.51@tcp:37:rm.0 Request processed in 4444us (4660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518114.172597:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:3.0:1789518114.176434:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518114.176533:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616948224 00000100:00100000:1.0:1789518114.176544:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616948224 00000100:00100000:1.0:1789518114.176606:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:1.0:1789518114.176656:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfa73450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+13:9651:x1876445616948224:12345-192.168.206.51@tcp:35:rm.0 00000100:00100000:1.0:1789518114.176938:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfa73450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+14:9651:x1876445616948224:12345-192.168.206.51@tcp:35:rm.0 Request processed in 285us (516us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789518114.176946:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:3.0:1789518114.179845:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518114.179983:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616948480 00000100:00100000:0.0:1789518114.180004:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616948480 00000100:00100000:0.0:1789518114.180091:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:0.0:1789518114.180101:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+14:9651:x1876445616948480:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:0.0:1789518114.180141:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518114.180164:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c780e1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc6f7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.180278:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c780e23 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.180294:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c780e23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.180307:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c780e23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518114.180320:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789518114.180521:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c780e1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6f7 expref: 17 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.180542:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c780e23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6f7 expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.180551:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99ffc2fdc900) 00010000:00010000:0.0:1789518114.180555:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789518114.180559:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28c200, rc 0) 00000100:00100000:0.0:1789518114.180684:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+16:9651:x1876445616948480:12345-192.168.206.51@tcp:101:rm.0 Request processed in 584us (851us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789518114.180692:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:3.0:1789518114.183546:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518114.183659:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616948608 00000100:00100000:0.0:1789518114.183693:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616948608 00000100:00100000:0.0:1789518114.183754:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:0.0:1789518114.183764:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+16:9651:x1876445616948608:12345-192.168.206.51@tcp:41:rm.0 00000004:00000024:0.0:1789518114.183834:0:8051:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1789518114.183911:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+16:9651:x1876445616948608:12345-192.168.206.51@tcp:41:rm.0 Request processed in 147us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518114.183918:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:3.0:1789518114.189294:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518114.189404:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616948736 00000100:00100000:0.0:1789518114.189417:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616948736 00000100:00100000:0.0:1789518114.189487:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:0.0:1789518114.189498:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+16:9651:x1876445616948736:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:0.0:1789518114.189524:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518114.189549:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c780e31 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc6fe expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.189672:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c780e38 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.189690:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c780e38 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.189704:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c780e38 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.189749:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c780e3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x3642342a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.189758:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c780e3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3642342a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.189776:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c780e3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3642342a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.189895:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c780e46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.189904:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c780e46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.189912:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c780e46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518114.189944:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789518114.189949:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518114.189969:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c780e46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.189983:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c780e46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.189992:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c780e38 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.189999:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c780e38 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.190006:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c780e38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.190012:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28da00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518114.190017:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c780e38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.190032:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c780e38 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.190045:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99ffc2fdc900) 00010000:00010000:0.0:1789518114.190049:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518114.190054:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c780e38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.190060:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c780e38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.190075:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c780e3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3642342a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.190081:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c780e3f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3642342a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.190087:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c780e3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3642342a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.190092:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518114.190095:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c780e3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3642342a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.190101:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c780e3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3642342a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.190120:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x3642342a (ffff99ffd2a17800) 00010000:00010000:0.0:1789518114.190123:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518114.190126:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c780e3f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x3642342a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.190143:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c780e3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x3642342a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.190179:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c780e31 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6fe expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.190194:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c780e46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6fe expref: 17 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.190202:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99ffd2a17700) 00010000:00010000:0.0:1789518114.190205:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518114.190208:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc800, rc 0) 00000100:00100000:0.0:1789518114.190344:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+17:9651:x1876445616948736:12345-192.168.206.51@tcp:101:rm.0 Request processed in 848us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518114.190352:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:1.0:1789518114.194033:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518114.194178:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616948992 00000100:00100000:0.0:1789518114.194191:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616948992 00000100:00100000:0.0:1789518114.194257:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:0.0:1789518114.194268:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff6f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+17:9651:x1876445616948992:12345-192.168.206.51@tcp:36:rm.0 00010000:00010000:0.0:1789518114.194334:0:8051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789518114.194365:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c780e46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6fe expref: 17 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.194390:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ce00/0x631fd8698c780df2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6e2 expref: 16 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.194427:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99ffd2a17700) 00010000:00010000:0.0:1789518114.194447:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c780e07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6e9 expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.194457:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99ffc2fdc900) 00010000:00010000:0.0:1789518114.194461:0:8051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518114.194482:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c780e4d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.194496:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c780e4d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.194506:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c780e4d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.194520:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c780e54 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x3642342a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.194528:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c780e54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3642342a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.194534:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c780e54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3642342a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.194981:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c780e5b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.195002:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c780e5b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.195011:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c780e5b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789518114.195853:0:8051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1789518114.195867:0:8051:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 168192252292ns, next at 169192249376ns, rc = 0 00010000:00010000:1.0:1789518114.195934:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c780e62 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.195946:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c780e62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.195955:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c780e62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.195965:0:8051:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c780e62 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.195982:0:8051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c780e62 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.195996:0:8051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c780e62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.196019:0:8051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518114.196043:0:8051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c780e5b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.196050:0:8051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c780e5b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.196056:0:8051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c780e5b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.196062:0:8051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f6a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518114.196067:0:8051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c780e5b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.196076:0:8051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c780e5b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.196087:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99ffc2fdc700) 00010000:00010000:1.0:1789518114.196090:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789518114.196095:0:8051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c780e5b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.196101:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c780e5b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.196129:0:8051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c780e4d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.196141:0:8051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c780e4d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.196147:0:8051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c780e4d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.196152:0:8051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518114.196155:0:8051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c780e4d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.196166:0:8051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c780e4d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.196173:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99ffc2fdc900) 00010000:00010000:1.0:1789518114.196175:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518114.196178:0:8051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c780e4d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.196184:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c780e4d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789518114.196196:0:8051:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c91b019d reply state 00000000cc98ed66 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c780e54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3642342a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518114.196206:0:8051:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789518114.196289:0:7596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518114.196302:0:7596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c780e62 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.196314:0:7596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f6c00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518114.196319:0:7596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c780e62 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518114.196329:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff6f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+16:9651:x1876445616948992:12345-192.168.206.51@tcp:36:rm.0 Request processed in 2059us (2310us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789518114.196344:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 29 00010000:00010000:0.0:1789518114.196359:0:7596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c780e62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.196377:0:7596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99ffc2fdc700) 00010000:00010000:0.0:1789518114.196380:0:7596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789518114.196386:0:7596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c780e62 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.196393:0:7596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c780e62 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.196415:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518114.196420:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518114.196423:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518114.199346:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518114.199462:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616949248 00000100:00100000:2.0:1789518114.199473:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616949248 00000100:00100000:2.0:1789518114.199531:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:2.0:1789518114.199542:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+16:9651:x1876445616949248:12345-192.168.206.51@tcp:35:rm.0 00000100:00100000:2.0:1789518114.199830:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+17:9651:x1876445616949248:12345-192.168.206.51@tcp:35:rm.0 Request processed in 290us (498us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789518114.199838:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:3.0:1789518114.202088:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518114.202169:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616949504 00000100:00100000:0.0:1789518114.202184:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616949504 00010000:00010000:1.0:1789518114.202284:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c780e54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3642342a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.202319:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c780e54 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3642342a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.202329:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c780e54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3642342a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.202337:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bca00 already unused, calling callback (ffffffffc1f3e4f0) 00000100:00100000:0.0:1789518114.202339:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 30 00010000:00010000:1.0:1789518114.202346:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c780e54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3642342a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518114.202356:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+17:9651:x1876445616949504:12345-192.168.206.51@tcp:36:rm.0 00010000:00010000:1.0:1789518114.202364:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c780e54 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3642342a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.202386:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x3642342a (ffff99ffd2a17900) 00010000:00010000:1.0:1789518114.202390:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518114.202396:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c780e54 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3642342a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.202403:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c780e54 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3642342a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.202412:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789518114.202442:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c780e23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6f7 expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.202468:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c780dc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6d4 expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.202480:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99ffc2fdc900) 00010000:00010000:0.0:1789518114.202496:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c780d82 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6c6 expref: 14 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.202523:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffd2a17e00) 00010000:00010000:0.0:1789518114.202531:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518114.202551:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c780e69 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.202563:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c780e69 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.202573:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c780e69 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.202584:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c780e70 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.202591:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c780e70 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.202598:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c780e70 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.202887:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c780e77 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.202896:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c780e77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.202904:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c780e77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518114.203427:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789518114.203442:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c780e77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.203454:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c780e77 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.203462:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c780e77 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.203468:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518114.203471:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c780e77 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.203479:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c780e77 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.203488:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99ffd2a17700) 00010000:00010000:0.0:1789518114.203491:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789518114.203495:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c780e77 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.203501:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c780e77 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.203516:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c780e69 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.203522:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c780e69 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.203528:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c780e69 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.203532:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518114.203541:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c780e69 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.203547:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c780e69 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.203555:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffd2a17800) 00010000:00010000:0.0:1789518114.203557:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518114.203560:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c780e69 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.203566:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c780e69 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518114.203578:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000ed80c26 reply state 000000007d2846f9 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c780e70 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518114.203586:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518114.203694:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+15:9651:x1876445616949504:12345-192.168.206.51@tcp:36:rm.0 Request processed in 1342us (1616us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789518114.203701:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 30 00010000:00010000:1.0:1789518114.207582:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c780e70 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.207605:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c780e70 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.207654:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c780e70 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.207677:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bcc00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518114.207701:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c780e70 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.207711:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c780e70 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.207730:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99ffd2a17a00) 00010000:00010000:1.0:1789518114.207734:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518114.207739:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c780e70 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518114.207746:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c780e70 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518114.226870:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518115.251778:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518116.275011:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789518116.468494:0:8168:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 170464877678ns, next at 171464875555ns, rc = 0 00000100:00100000:1.0:1789518116.468515:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789518116.468532:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff6f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627458816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518116.468592:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518116.468675:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627458816 00000100:00100000:1.0:1789518116.468682:0:6652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627458816 00000100:00100000:1.0:1789518116.468734:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789518116.468744:0:6652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627458816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789518116.468773:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789518116.468815:0:6652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627458816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518116.468822:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1789518116.468843:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789518116.468872:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffff6f5c00 x1876445627458816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518132 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518116.468903:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff6f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627458816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518116.470147:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:824c8f07-28fa-48fd-81af-173b194570e6:3282:1876445627458944:0@lo:400:kworker.0 00000100:00100000:3.0:1789518116.470194:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518116.470334:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627459072:0@lo:400:kworker.0 00000100:00100000:2.0:1789518116.470369:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518116.470399:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789518116.470405:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627459456:0@lo:400:kworker.0 00000100:00100000:2.0:1789518116.470427:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518116.470455:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627459328:0@lo:400:kworker.0 00000100:00100000:2.0:1789518116.470480:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518116.470499:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789518116.470506:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627459200:0@lo:400:kworker.0 00000100:00100000:2.0:1789518116.470529:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518116.470554:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627459072 00000100:00100000:2.0:1789518116.470560:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627459072 00000100:00100000:2.0:1789518116.470595:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627459456 00000100:00100000:2.0:1789518116.470598:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627459456 00000100:00100000:2.0:1789518116.470641:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627459200 00000100:00100000:2.0:1789518116.470651:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627459200 00000100:00100000:2.0:1789518116.470672:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789518116.470680:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627459072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518116.470729:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627459072:12345-0@lo:400:kworker.0 Request processed in 50us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518116.470737:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789518116.470756:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789518116.470764:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627459456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518116.470799:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627459456:12345-0@lo:400:kworker.0 Request processed in 37us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518116.470805:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789518116.470820:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789518116.470827:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627459200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518116.470859:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627459200:12345-0@lo:400:kworker.0 Request processed in 34us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518116.470864:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789518116.470885:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627459328 00000100:00100000:2.0:1789518116.470888:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627459328 00000100:00100000:2.0:1789518116.470913:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789518116.470920:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627459328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518116.470949:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627459328:12345-0@lo:400:kworker.0 Request processed in 30us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518116.470954:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1789518116.470979:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789518116.470984:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518116.471010:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627459200:0@lo:400:kworker.0 00010000:00080000:2.0:1789518116.471035:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffeda7a300 x1876445627459328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518116.471045:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627459328:0@lo:400:kworker.0 00000100:00100000:2.0:1789518116.471075:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627459456:0@lo:400:kworker.0 00000100:00100000:2.0:1789518116.471085:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627459072:0@lo:400:kworker.0 00000100:00100000:1.0:1789518116.471241:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627458944 00000100:00100000:1.0:1789518116.471245:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627458944 00000100:00100000:1.0:1789518116.471282:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789518116.471289:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+19:3282:x1876445627458944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518116.471377:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+19:3282:x1876445627458944:12345-0@lo:400:kworker.0 Request processed in 88us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518116.471383:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789518116.471470:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:824c8f07-28fa-48fd-81af-173b194570e6:3282:1876445627458944:0@lo:400:kworker.0 00000001:02000400:3.0:1789518116.539326:0:11566:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000020:00000080:0.0:1789518117.174431:0:11614:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd07378b40 20000000:00000080:0.0:1789518117.174447:0:11614:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99ffee58b400 uarg=0000000000000000 20000000:01000000:0.0:1789518117.174480:0:11614:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789518117.174486:0:11614:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789518117.174491:0:11614:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1789518117.175388:0:11615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1789518117.175547:0:11614:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1789518117.181520:0:11614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1789518117.181574:0:11614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1789518117.181757:0:11614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1789518117.181781:0:11614:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789518117.181798:0:11614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ffed5bda00/0x631fd8698c780e7e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518117.181815:0:11614:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffc6b17200/0x631fd8698c780d27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780d20 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518117.181823:0:11614:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99fffc28c600/0x631fd8698c780d35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780d2e expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518117.181830:0:11614:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffc6b16400/0x631fd8698c780d43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780d3c expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518117.181839:0:11614:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffc6b16c00/0x631fd8698c780d4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6b1 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518117.181846:0:11614:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780d51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6b8 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518117.181853:0:11614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ffed5bda00/0x631fd8698c780e7e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518117.181886:0:11614:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780d51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6b8 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518117.181959:0:11614:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780d51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6b8 expref: 12 pid: 5805 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518117.181973:0:11614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6502300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11614:1876445627459584:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518117.182064:0:11614:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffc6b16c00/0x631fd8698c780d4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6b1 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518117.182082:0:11614:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ffc6b16c00/0x631fd8698c780d4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6b1 expref: 12 pid: 5805 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518117.182091:0:11614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6502a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11614:1876445627459712:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518117.182196:0:11614:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffc6b16400/0x631fd8698c780d43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c780d3c expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518117.182204:0:11614:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffc6b16400/0x631fd8698c780d43 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c780d3c expref: 18 pid: 5806 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518117.182214:0:11614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a59f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11614:1876445627459840:0@lo:104: 00000100:00100000:0.0:1789518117.182248:0:11614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789518117.182275:0:11614:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99fffc28c600/0x631fd8698c780d35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c780d2e expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518117.182283:0:11614:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99fffc28c600/0x631fd8698c780d35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c780d2e expref: 18 pid: 5807 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518117.182290:0:11614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a5b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11614:1876445627459968:0@lo:104: 00000100:00100000:0.0:1789518117.182306:0:11614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518117.182336:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627459840 00000100:00100000:0.0:1789518117.182342:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627459840 00000100:00100000:0.0:1789518117.182377:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627459968 00000100:00100000:0.0:1789518117.182380:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627459968 00000100:00100000:0.0:1789518117.182394:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789518117.182402:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:824c8f07-28fa-48fd-81af-173b194570e6+4:11614:x1876445627459840:12345-0@lo:104: 00010000:00010000:0.0:1789518117.182414:0:8412:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99fffc28d400/0x631fd8698c780d3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780d43 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518117.182464:0:8412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789518117.182470:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:824c8f07-28fa-48fd-81af-173b194570e6+4:11614:x1876445627459840:12345-0@lo:104: Request processed in 68us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518117.182476:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789518117.182491:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789518117.182496:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:824c8f07-28fa-48fd-81af-173b194570e6+3:11614:x1876445627459968:12345-0@lo:104: 00010000:00010000:0.0:1789518117.182503:0:8412:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffc0031800/0x631fd8698c780d2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780d35 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518117.182533:0:8412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789518117.182537:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:824c8f07-28fa-48fd-81af-173b194570e6+3:11614:x1876445627459968:12345-0@lo:104: Request processed in 42us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518117.182542:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1789518117.182558:0:7596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789518117.182563:0:7596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99fffc28d400/0x631fd8698c780d3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780d43 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518117.182569:0:7596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28d400 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:0.0:1789518117.182572:0:7596:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99fffc28d400/0x631fd8698c780d3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c780d43 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518117.182579:0:7596:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99fffc28d400/0x631fd8698c780d3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c780d43 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518117.182586:0:7596:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99fffc28d400/0x631fd8698c780d3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c780d43 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518117.182591:0:7596:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789518117.182640:0:7596:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99fffc28d400/0x631fd8698c780d3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780d43 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518117.182646:0:7596:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518117.183048:0:7595:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518117.183055:0:7595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc0031800/0x631fd8698c780d2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780d35 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518117.183063:0:7595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc0031800 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:3.0:1789518117.183067:0:7595:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc0031800/0x631fd8698c780d2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c780d35 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518117.183075:0:7595:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc0031800/0x631fd8698c780d2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c780d35 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518117.183108:0:7595:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc0031800/0x631fd8698c780d2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c780d35 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518117.183115:0:7595:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789518117.183136:0:7595:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffc0031800/0x631fd8698c780d2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780d35 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518117.183142:0:7595:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518117.183157:0:7595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc0031800/0x631fd8698c780d2e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780d35 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518117.183165:0:7595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc0031800/0x631fd8698c780d2e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780d35 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518117.183177:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518117.183179:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518117.183180:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518117.183187:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789518117.183197:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:824c8f07-28fa-48fd-81af-173b194570e6:3282:1876445627460224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518117.183227:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518117.183263:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627460224 00000100:00100000:3.0:1789518117.183267:0:5798:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627460224 00010000:00010000:3.0:1789518117.183286:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99fffc28c600/0x631fd8698c780d35 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780d2e expref: 19 pid: 5807 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518117.183307:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789518117.183314:0:5798:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff497b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:824c8f07-28fa-48fd-81af-173b194570e6+19:3282:x1876445627460224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789518117.183323:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518117.183333:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99fffc28c600/0x631fd8698c780d35 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780d2e expref: 19 pid: 5807 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518117.183343:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99fffc28c600/0x631fd8698c780d35 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c780d2e expref: 19 pid: 5807 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518117.183356:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518117.183384:0:5798:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff497b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:824c8f07-28fa-48fd-81af-173b194570e6+19:3282:x1876445627460224:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518117.183391:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789518117.183428:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:824c8f07-28fa-48fd-81af-173b194570e6:3282:1876445627460224:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789518117.184911:0:7596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99fffc28d400/0x631fd8698c780d3c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780d43 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518117.184922:0:7596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99fffc28d400/0x631fd8698c780d3c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780d43 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518117.184935:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518117.184936:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518117.184938:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518117.184979:0:11614:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffc6b17200/0x631fd8698c780d27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c780d20 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518117.184995:0:11614:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffc6b17200/0x631fd8698c780d27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c780d20 expref: 18 pid: 5806 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518117.185007:0:11614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a58e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11614:1876445627460352:0@lo:104: 00000100:00100000:0.0:1789518117.185050:0:11614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518117.185051:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789518117.185065:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:824c8f07-28fa-48fd-81af-173b194570e6:3281:1876445627460096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518117.185087:0:8412:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789518117.185110:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518117.185114:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627460352 00000100:00100000:0.0:1789518117.185121:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627460352 00000100:00100000:2.0:1789518117.185142:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627460096 00000100:00100000:2.0:1789518117.185147:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627460096 00010000:00010000:2.0:1789518117.185166:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffc6b16400/0x631fd8698c780d43 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780d3c expref: 19 pid: 5806 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518117.185190:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789518117.185197:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff631500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:824c8f07-28fa-48fd-81af-173b194570e6+19:3281:x1876445627460096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789518117.185206:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518117.185210:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffc6b16400/0x631fd8698c780d43 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780d3c expref: 19 pid: 5806 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518117.185219:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffc6b16400/0x631fd8698c780d43 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c780d3c expref: 19 pid: 5806 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518117.185232:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518117.185259:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff631500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:824c8f07-28fa-48fd-81af-173b194570e6+19:3281:x1876445627460096:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518117.185266:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789518117.185306:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:824c8f07-28fa-48fd-81af-173b194570e6:3281:1876445627460096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518117.185340:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789518117.185351:0:11614:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7801a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789518117.185351:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed74bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:824c8f07-28fa-48fd-81af-173b194570e6+3:11614:x1876445627460352:12345-0@lo:104: 00010000:00010000:0.0:1789518117.185365:0:8412:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99fffc28de00/0x631fd8698c780d20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780d27 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518117.185370:0:11614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b16400/0x631fd8698c780d43 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c780d3c expref: 18 pid: 5806 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518117.185386:0:11614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a59f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11614:1876445627459840:0@lo:104: 00010000:00010000:2.0:1789518117.185396:0:11614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc28c600/0x631fd8698c780d35 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c780d2e expref: 17 pid: 5807 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518117.185407:0:11614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a5b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11614:1876445627459968:0@lo:104: 00000100:00100000:2.0:1789518117.185418:0:11614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a58e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11614:1876445627460352:0@lo:104: 00010000:00010000:0.0:1789518117.185418:0:8412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789518117.185432:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed74bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:824c8f07-28fa-48fd-81af-173b194570e6+3:11614:x1876445627460352:12345-0@lo:104: Request processed in 84us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518117.185440:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1789518117.185577:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518117.185583:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99fffc28de00/0x631fd8698c780d20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c780d27 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518117.185590:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28de00 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:1.0:1789518117.185595:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99fffc28de00/0x631fd8698c780d20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c780d27 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518117.185604:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99fffc28de00/0x631fd8698c780d20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c780d27 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518117.185610:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99fffc28de00/0x631fd8698c780d20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c780d27 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518117.185660:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789518117.185691:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99fffc28de00/0x631fd8698c780d20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780d27 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518117.185698:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789518117.185719:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99fffc28de00/0x631fd8698c780d20 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780d27 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518117.185725:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1789518117.185735:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99fffc28de00/0x631fd8698c780d20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c780d27 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518117.185737:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff6f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:824c8f07-28fa-48fd-81af-173b194570e6:3280:1876445627460480:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789518117.185757:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518117.185759:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518117.185761:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518117.185780:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518117.185844:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627460480 00000100:00100000:1.0:1789518117.185848:0:5798:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627460480 00010000:00010000:1.0:1789518117.185864:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffc6b17200/0x631fd8698c780d27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780d20 expref: 17 pid: 5806 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518117.185902:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789518117.185909:0:5798:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd8066450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:824c8f07-28fa-48fd-81af-173b194570e6+17:3280:x1876445627460480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789518117.185917:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518117.185921:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffc6b17200/0x631fd8698c780d27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c780d20 expref: 17 pid: 5806 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518117.185930:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffc6b17200/0x631fd8698c780d27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c780d20 expref: 17 pid: 5806 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518117.185941:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b17200/0x631fd8698c780d27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c780d20 expref: 17 pid: 5806 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518117.185949:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518117.185980:0:5798:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd8066450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:824c8f07-28fa-48fd-81af-173b194570e6+16:3280:x1876445627460480:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518117.185986:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789518117.186044:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff6f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:824c8f07-28fa-48fd-81af-173b194570e6:3280:1876445627460480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789518117.188430:0:11614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6502300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11614:1876445627459584:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518117.188443:0:11614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6502a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11614:1876445627459712:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518117.188475:0:11614:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ffed5bda00/0x631fd8698c780e7e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518117.190404:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518117.190556:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616949632 00000100:00100000:2.0:1789518117.190565:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616949632 00010000:00010000:2.0:1789518117.190598:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780d51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6b8 expref: 13 pid: 5805 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518117.190665:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:2.0:1789518117.190676:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4978a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e55716f-fc49-42ce-abad-050985078c82+13:2344:x1876445616949632:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518117.190690:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518117.190713:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780d51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6b8 expref: 13 pid: 5805 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518117.190725:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780d51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6b8 expref: 13 pid: 5805 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518117.190742:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc0030a00/0x631fd8698c780d51 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6b8 expref: 13 pid: 5805 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518117.190762:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518117.190815:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4978a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e55716f-fc49-42ce-abad-050985078c82+12:2344:x1876445616949632:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 142us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518117.190822:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:0.0:1789518117.191675:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518117.191701:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616949760 00000100:00100000:1.0:1789518117.191707:0:5798:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616949760 00010000:00010000:1.0:1789518117.191729:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffc6b16c00/0x631fd8698c780d4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6b1 expref: 12 pid: 5805 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518117.191755:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:1.0:1789518117.191763:0:5798:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e55716f-fc49-42ce-abad-050985078c82+12:2344:x1876445616949760:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518117.191772:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518117.191777:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffc6b16c00/0x631fd8698c780d4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6b1 expref: 12 pid: 5805 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518117.191787:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffc6b16c00/0x631fd8698c780d4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6b1 expref: 12 pid: 5805 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518117.191798:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b16c00/0x631fd8698c780d4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc6b1 expref: 12 pid: 5805 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518117.191810:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ffed5bda00/0x631fd8698c780e7e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518117.191819:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bda00/0x631fd8698c780e7e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518117.191835:0:5798:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffed5bda00/0x631fd8698c780e7e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518117.191848:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffed5bda00/0x631fd8698c780e7e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518117.191854:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ffed5bda00/0x631fd8698c780e7e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518117.191871:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ffed5bda00/0x631fd8698c780e7e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518117.191877:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bda00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518117.191881:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ffed5bda00/0x631fd8698c780e7e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518117.191899:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ffed5bda00/0x631fd8698c780e7e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518117.191922:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ffed5bda00/0x631fd8698c780e7e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518117.191932:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518117.191972:0:5798:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e55716f-fc49-42ce-abad-050985078c82+11:2344:x1876445616949760:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 209us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518117.191980:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 34 00010000:00010000:0.0:1789518117.192427:0:11614:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ffed5bda00/0x631fd8698c780e7e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518117.192437:0:11614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ffed5bda00/0x631fd8698c780e7e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518117.192444:0:11614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffed5bda00/0x631fd8698c780e7e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518117.298971:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518118.286433:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518118.286475:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518118.286505:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518118.286530:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518118.287001:0:6647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616950144 00000100:00100000:2.0:1789518118.287012:0:6647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616950144 00000100:00100000:2.0:1789518118.287075:0:6647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:2.0:1789518118.287086:0:6647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2342:x1876445616950144:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518118.287087:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616950016 00000100:00100000:3.0:1789518118.287104:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616950016 00000100:00100000:3.0:1789518118.287136:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616950272 00000100:00100000:3.0:1789518118.287141:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616950272 00000100:00100000:2.0:1789518118.287182:0:6647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2342:x1876445616950144:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 98us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518118.287189:0:6647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00080000:2.0:1789518118.287210:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789518118.287218:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518118.287281:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00100000:1.0:1789518118.287285:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616949888 00000100:00100000:1.0:1789518118.287291:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616949888 00000100:00100000:3.0:1789518118.287296:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff497a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+14:2342:x1876445616950016:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518118.287327:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 229 00000100:00100000:3.0:1789518118.287337:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff497a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+14:2342:x1876445616950016:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 45us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518118.287339:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+11:2342:x1876445616949888:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518118.287376:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+11:2342:x1876445616949888:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 41us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518118.287381:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 229 00000100:00100000:2.0:1789518118.287809:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 58 00000100:00100000:2.0:1789518118.287820:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff497aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2342:x1876445616950272:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518118.288267:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff497aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2342:x1876445616950272:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 448us (1734us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518118.288277:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 58 00000100:00100000:3.0:1789518118.291399:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00100000:3.0:1789518118.294959:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518118.295081:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518118.295281:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616950400 00000100:00100000:2.0:1789518118.295290:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616950400 00000100:00100000:2.0:1789518118.295358:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616950528 00000100:00100000:2.0:1789518118.295361:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616950528 00000100:00100000:2.0:1789518118.295383:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:2.0:1789518118.295392:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff497b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2341:x1876445616950400:12345-192.168.206.51@tcp:9:kworker.0 00000020:00000080:2.0:1789518118.295435:0:6648:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c780d12 00000100:00080000:2.0:1789518118.295444:0:6648:0:(import.c:65:import_set_state_nolock()) ffff99ffc4f40800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789518118.295475:0:6648:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789518118.295547:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:1.0:1789518118.295559:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff40bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2341:x1876445616950528:12345-192.168.206.51@tcp:9:kworker.0 00000020:00000080:1.0:1789518118.295587:0:6649:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c780d0b 00000100:00080000:1.0:1789518118.295593:0:6649:0:(import.c:65:import_set_state_nolock()) ffff99fff7b5e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789518118.295641:0:6649:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1789518118.295953:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff497b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e523f9d-cd98-44af-a94f-935bacbf145f+2:2341:x1876445616950400:12345-192.168.206.51@tcp:9:kworker.0 Request processed in 560us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518118.295961:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:1.0:1789518118.296030:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff40bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e523f9d-cd98-44af-a94f-935bacbf145f+2:2341:x1876445616950528:12345-192.168.206.51@tcp:9:kworker.0 Request processed in 473us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518118.296039:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 17 00010000:00010000:2.0:1789518118.296134:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789518118.297003:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789518118.297018:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789518118.297025:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518118.322819:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518118.515492:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff6f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627460608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518118.515552:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518118.515608:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627460608 00000100:00100000:1.0:1789518118.515637:0:6652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627460608 00000100:00100000:1.0:1789518118.515683:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789518118.515690:0:6652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff6f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627460608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789518118.515716:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789518118.515769:0:6652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff6f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627460608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518118.515776:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1789518118.515815:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffff6f6680 x1876445627460608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518134 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518118.515832:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff6f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627460608:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789518118.516289:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1789518118.546349:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0e523f9d-cd98-44af-a94f-935bacbf145f 00000020:00000080:1.0:1789518118.546359:0:6674:0:(genops.c:885:class_export_put()) final put ffff99ffc4f44000/0e523f9d-cd98-44af-a94f-935bacbf145f 00000020:00000080:3.0:1789518118.546448:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc4f44000/0e523f9d-cd98-44af-a94f-935bacbf145f for lustre-OST0000 00000020:00000080:3.0:1789518118.546851:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffc4f40800 for lustre-OST0000 10000000:01000000:3.0:1789518118.578851:0:5810:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789518118.578859:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ffff791800 from 7 10000000:01000000:3.0:1789518118.578863:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789518118.578907:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17000/0x631fd8698c780e85 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518118.578920:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17000/0x631fd8698c780e85 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518118.578931:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17000/0x631fd8698c780e85 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518118.578954:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4979f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627460736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789518118.579021:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518118.579229:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd811df00 going to sleep for 11 seconds 00000100:00100000:2.0:1789518118.580263:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627460736 00000100:00100000:2.0:1789518118.580271:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627460736 00000100:00100000:2.0:1789518118.580377:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789518118.580387:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+16:5810:x1876445627460736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789518118.580402:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518118.580418:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780e8c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780e85 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518118.580440:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780e8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780e85 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518118.580467:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780e8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780e85 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518118.580475:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29c8800, rc 0) 00000100:00100000:2.0:1789518118.580541:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+17:5810:x1876445627460736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (1519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518118.580559:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1789518118.580651:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4979f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627460736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518118.580668:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17000/0x631fd8698c780e85 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780e8c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518118.580677:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17000/0x631fd8698c780e85 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780e8c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518118.580743:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4979f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627460864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518118.581358:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518118.581403:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd811df00 going to sleep for 11 seconds 00000100:00100000:1.0:1789518118.581477:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627460864 00000100:00100000:1.0:1789518118.581482:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627460864 00000100:00100000:1.0:1789518118.581519:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789518118.581526:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+17:5810:x1876445627460864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518118.581792:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+17:5810:x1876445627460864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 265us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518118.581800:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1789518118.582008:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4979f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627460864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518118.582044:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4979f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627460992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789518118.582082:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518118.582125:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd811df00 going to sleep for 11 seconds 00000100:00100000:2.0:1789518118.582343:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627460992 00000100:00100000:2.0:1789518118.582348:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627460992 00000100:00100000:2.0:1789518118.582385:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789518118.582393:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+17:5810:x1876445627460992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789518118.582535:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+17:5810:x1876445627460992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518118.582542:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789518118.582649:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4979f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627460992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789518118.583472:0:11628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4979f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:11628:1876445627461120:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518118.583513:0:11628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518118.583545:0:11628:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd811d600 going to sleep for 11 seconds 00000100:00100000:1.0:1789518118.583607:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627461120 00000100:00100000:1.0:1789518118.583639:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627461120 00000100:00100000:1.0:1789518118.583675:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789518118.583683:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+17:11628:x1876445627461120:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518118.583858:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+17:11628:x1876445627461120:12345-0@lo:502:llog_process_th.0 Request processed in 175us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518118.583865:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1789518118.584005:0:11628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4979f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:11628:1876445627461120:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789518118.584028:0:11628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518118.584037:0:11628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518118.584040:0:11628:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789518118.584047:0:11628:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99ffff791800 00000020:00000080:3.0:1789518118.584049:0:11628:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789518118.584130:0:11628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4979f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:11628:1876445627461248:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518118.584163:0:11628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518118.584196:0:11628:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd811d600 going to sleep for 11 seconds 00000100:00100000:0.0:1789518118.584431:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627461248 00000100:00100000:0.0:1789518118.584436:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627461248 00000100:00100000:0.0:1789518118.584470:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789518118.584478:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+17:11628:x1876445627461248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518118.584602:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+17:11628:x1876445627461248:12345-0@lo:502:llog_process_th.0 Request processed in 124us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518118.584610:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789518118.585423:0:11628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4979f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:11628:1876445627461248:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789518118.585447:0:11628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518118.585453:0:11628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518118.585455:0:11628:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789518118.585459:0:11628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789518118.585607:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789518118.585654:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789518118.585665:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17000/0x631fd8698c780e85 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780e8c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518118.585676:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17000/0x631fd8698c780e85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780e8c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518118.585686:0:5810:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789518118.585689:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ffc76f3000 from 7 10000000:01000000:2.0:1789518118.585691:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789518118.585715:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9400/0x631fd8698c780e93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518118.585723:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9400/0x631fd8698c780e93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518118.585731:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9400/0x631fd8698c780e93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518118.585760:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff630000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627461376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789518118.585802:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518118.585825:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff406e180 going to sleep for 11 seconds 00000100:00100000:3.0:1789518118.585943:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627461376 00000100:00100000:3.0:1789518118.585949:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627461376 00000100:00100000:3.0:1789518118.585977:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789518118.585992:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+17:5810:x1876445627461376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518118.586003:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518118.586014:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c780e9a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780e93 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518118.586034:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c780e9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780e93 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518118.586043:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c780e9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780e93 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518118.586050:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17e00, rc 0) 00000100:00100000:3.0:1789518118.586081:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+18:5810:x1876445627461376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518118.586102:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789518118.586567:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff630000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627461376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789518118.586580:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9400/0x631fd8698c780e93 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780e9a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518118.586590:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9400/0x631fd8698c780e93 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780e9a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518118.586668:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff630000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627461504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789518118.586697:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518118.586714:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff406e180 going to sleep for 11 seconds 00000100:00100000:3.0:1789518118.587432:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627461504 00000100:00100000:3.0:1789518118.587438:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627461504 00000100:00100000:3.0:1789518118.587464:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789518118.587472:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+18:5810:x1876445627461504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518118.587724:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+18:5810:x1876445627461504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518118.587731:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789518118.588415:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff630000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627461504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789518118.588458:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff630000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627461632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789518118.588506:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518118.588544:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff406e180 going to sleep for 11 seconds 00000100:00100000:3.0:1789518118.588644:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627461632 00000100:00100000:3.0:1789518118.588649:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627461632 00000100:00100000:3.0:1789518118.588675:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789518118.588682:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc777b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+18:5810:x1876445627461632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789518118.590490:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc777b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+18:5810:x1876445627461632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1802us (1978us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518118.590508:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789518118.591366:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff630000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627461632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518118.593553:0:11630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a59180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:11630:1876445627461760:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518118.594380:0:11630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518118.594431:0:11630:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff78010c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518118.594676:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627461760 00000100:00100000:2.0:1789518118.594686:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627461760 00000100:00100000:2.0:1789518118.594741:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789518118.594750:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc777bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+18:11630:x1876445627461760:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789518118.595017:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc777bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+18:11630:x1876445627461760:12345-0@lo:502:llog_process_th.0 Request processed in 267us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518118.595025:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789518118.595282:0:11630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a59180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:11630:1876445627461760:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789518118.595316:0:11630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518118.595326:0:11630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518118.595329:0:11630:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789518118.595337:0:11630:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99ffc76f3000 00000020:00000080:0.0:1789518118.595344:0:11630:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789518118.595449:0:11630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a59180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:11630:1876445627461888:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518118.595487:0:11630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518118.595511:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627461888 00000100:00100000:0.0:1789518118.595515:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627461888 00000100:00100000:0.0:1789518118.595537:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789518118.595543:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc777a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+18:11630:x1876445627461888:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518118.595679:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc777a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+18:11630:x1876445627461888:12345-0@lo:502:llog_process_th.0 Request processed in 135us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518118.595685:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789518118.595726:0:11630:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff78010c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518118.595737:0:11630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a59180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:11630:1876445627461888:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789518118.595752:0:11630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518118.595756:0:11630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518118.595758:0:11630:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789518118.595761:0:11630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789518118.596353:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789518118.596384:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789518118.596396:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9400/0x631fd8698c780e93 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780e9a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518118.596407:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9400/0x631fd8698c780e93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780e9a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518118.596417:0:5810:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789518118.596420:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ffc84db000 from 7 10000000:01000000:2.0:1789518118.596424:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789518118.596454:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9800/0x631fd8698c780ea1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518118.596463:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9800/0x631fd8698c780ea1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518118.596473:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9800/0x631fd8698c780ea1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518118.596490:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff630000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627462016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789518118.596530:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518118.596571:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff406ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1789518118.596779:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627462016 00000100:00100000:0.0:1789518118.596785:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627462016 00000100:00100000:0.0:1789518118.596824:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789518118.596834:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7779c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+18:5810:x1876445627462016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518118.596847:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518118.596861:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffed5bd400/0x631fd8698c780ea8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c780ea1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518118.596896:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bd400/0x631fd8698c780ea8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c780ea1 expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518118.596909:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffed5bd400/0x631fd8698c780ea8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c780ea1 expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518118.596927:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd400, rc 0) 00000100:00100000:0.0:1789518118.596964:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7779c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+19:5810:x1876445627462016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518118.596971:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789518118.597284:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff630000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627462016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789518118.597311:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9800/0x631fd8698c780ea1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780ea8 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518118.597324:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9800/0x631fd8698c780ea1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780ea8 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518118.598374:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff630000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627462144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789518118.598435:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518118.598479:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff406ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1789518118.598544:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627462144 00000100:00100000:3.0:1789518118.598552:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627462144 00000100:00100000:3.0:1789518118.598602:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789518118.598644:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+19:5810:x1876445627462144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518118.598902:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+19:5810:x1876445627462144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 291us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518118.598910:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789518118.599122:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff630000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627462144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518118.599157:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff6f6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627462272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518118.600465:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518118.600511:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffed7433c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518118.600886:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627462272 00000100:00100000:2.0:1789518118.600893:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627462272 00000100:00100000:2.0:1789518118.600932:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789518118.600939:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc777a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+19:5810:x1876445627462272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789518118.601100:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc777a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+19:5810:x1876445627462272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518118.601107:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789518118.601414:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff6f6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:824c8f07-28fa-48fd-81af-173b194570e6:5810:1876445627462272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789518118.609293:0:11632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4979f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:11632:1876445627462400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518118.609386:0:11632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518118.609420:0:11632:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc4f94900 going to sleep for 11 seconds 00000100:00100000:3.0:1789518118.609478:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627462400 00000100:00100000:3.0:1789518118.609485:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627462400 00000100:00100000:3.0:1789518118.609534:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789518118.609543:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7779450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+19:11632:x1876445627462400:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789518118.609891:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7779450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+19:11632:x1876445627462400:12345-0@lo:502:llog_process_th.0 Request processed in 347us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518118.609900:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789518118.610152:0:11632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4979f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:11632:1876445627462400:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789518118.610180:0:11632:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518118.610188:0:11632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518118.610190:0:11632:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789518118.610199:0:11632:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99ffc84db000 00000020:00000080:3.0:1789518118.610202:0:11632:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789518118.610452:0:11632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4979f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:11632:1876445627462528:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518118.610491:0:11632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518118.610560:0:11632:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffc27a6c0 going to sleep for 11 seconds 00000040:00080000:2.0:1789518118.614769:0:11633:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789518118.618600:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627462528 00000100:00100000:1.0:1789518118.618625:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627462528 00000100:00100000:1.0:1789518118.618682:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1789518118.618692:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7778c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+19:11632:x1876445627462528:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518118.618961:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7778c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+19:11632:x1876445627462528:12345-0@lo:502:llog_process_th.0 Request processed in 270us (8469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518118.618969:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789518118.620006:0:11632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4979f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:824c8f07-28fa-48fd-81af-173b194570e6:11632:1876445627462528:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789518118.620040:0:11632:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789518118.620048:0:11632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518118.620051:0:11632:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789518118.620055:0:11632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789518118.620262:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789518118.620283:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789518118.620292:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9800/0x631fd8698c780ea1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780ea8 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518118.620310:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9800/0x631fd8698c780ea1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780ea8 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518118.733146:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518118.733448:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616950656 00000100:00100000:0.0:1789518118.733459:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616950656 00000100:00100000:0.0:1789518118.733516:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 245 00000100:00100000:0.0:1789518118.733525:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7778050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+11:5579:x1876445616950656:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518118.733541:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518118.733558:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffed5bc600/0x631fd8698c780eaf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc705 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518118.733586:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bc600/0x631fd8698c780eaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc705 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518118.733597:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffed5bc600/0x631fd8698c780eaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc705 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518118.733606:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc600, rc 0) 00000100:00100000:0.0:1789518118.733688:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7778050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+12:5579:x1876445616950656:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 163us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518118.733695:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 245 00000100:00100000:2.0:1789518118.735932:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518118.736068:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616950784 00000100:00100000:0.0:1789518118.736076:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616950784 00000100:00100000:0.0:1789518118.736178:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 246 00000100:00100000:0.0:1789518118.736189:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7778450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+12:5579:x1876445616950784:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518118.736449:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7778450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+12:5579:x1876445616950784:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 262us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518118.736455:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 246 00000100:00100000:3.0:1789518118.741832:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518118.742048:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616950912 00000100:00100000:1.0:1789518118.742058:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616950912 00000100:00100000:1.0:1789518118.742123:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 247 00000100:00100000:1.0:1789518118.742132:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc777b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+12:5579:x1876445616950912:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518118.742326:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc777b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+12:5579:x1876445616950912:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 194us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518118.742334:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 247 00000100:00100000:3.0:1789518118.745958:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518118.746227:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616951040 00000100:00100000:0.0:1789518118.746237:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616951040 00000100:00100000:0.0:1789518118.746287:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 248 00000100:00100000:0.0:1789518118.746297:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+12:9921:x1876445616951040:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789518118.746504:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+12:9921:x1876445616951040:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 208us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518118.746513:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 248 00000100:00100000:3.0:1789518118.750457:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518118.750803:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616951168 00000100:00100000:2.0:1789518118.750813:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616951168 00000100:00100000:2.0:1789518118.750866:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 249 00000100:00100000:2.0:1789518118.750876:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7779050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+12:9921:x1876445616951168:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789518118.751105:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7779050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+12:9921:x1876445616951168:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 230us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518118.751122:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 249 00000100:00100000:3.0:1789518118.754814:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518118.755208:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616951296 00000100:00100000:1.0:1789518118.755218:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616951296 00000100:00100000:1.0:1789518118.755284:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 250 00000100:00100000:1.0:1789518118.755294:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc777a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+12:5579:x1876445616951296:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518118.755309:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518118.755326:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc2f7a00/0x631fd8698c780eb6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc70c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518118.755354:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc2f7a00/0x631fd8698c780eb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc70c expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518118.755366:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc2f7a00/0x631fd8698c780eb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc70c expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518118.755374:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f7a00, rc 0) 00000100:00100000:1.0:1789518118.755425:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc777a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+13:5579:x1876445616951296:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 132us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518118.755444:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 250 00000100:00100000:3.0:1789518118.758253:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518118.758422:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616951424 00000100:00100000:0.0:1789518118.758430:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616951424 00000100:00100000:0.0:1789518118.758533:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 251 00000100:00100000:0.0:1789518118.758543:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc777ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+13:5579:x1876445616951424:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518118.758808:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc777ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+13:5579:x1876445616951424:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 265us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518118.758815:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 251 00000100:00100000:3.0:1789518118.760423:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518118.761498:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616951552 00000100:00100000:1.0:1789518118.761508:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616951552 00000100:00100000:1.0:1789518118.761559:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 252 00000100:00100000:1.0:1789518118.761568:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc777b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+13:5579:x1876445616951552:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518118.761815:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc777b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+13:5579:x1876445616951552:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 246us (1395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518118.761822:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 252 00000100:00100000:3.0:1789518118.767846:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518118.767950:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616951680 00000100:00100000:0.0:1789518118.767959:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616951680 00000100:00100000:0.0:1789518118.768063:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 253 00000100:00100000:0.0:1789518118.768073:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc8101c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+13:9924:x1876445616951680:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789518118.768332:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc8101c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+13:9924:x1876445616951680:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 251us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518118.768340:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 253 00000100:00100000:3.0:1789518118.770993:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518118.771455:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616951808 00000100:00100000:2.0:1789518118.771464:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616951808 00000100:00100000:2.0:1789518118.771659:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 254 00000100:00100000:2.0:1789518118.771670:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc8103450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+13:9924:x1876445616951808:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789518118.771900:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc8103450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+13:9924:x1876445616951808:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 231us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518118.771912:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 254 00010000:00010000:1.0:1789518119.347318:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789518119.575811:0:7607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0e523f9d-cd98-44af-a94f-935bacbf145f 00000020:00000080:2.0:1789518119.575818:0:7607:0:(genops.c:885:class_export_put()) final put ffff99fff7b5b800/0e523f9d-cd98-44af-a94f-935bacbf145f 00000020:00000080:0.0:1789518119.575964:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99fff7b5b800/0e523f9d-cd98-44af-a94f-935bacbf145f for lustre-OST0001 00000020:00000080:0.0:1789518119.576152:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99fff7b5e800 for lustre-OST0001 00000001:00080000:3.0:1789518119.578128:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1789518119.578144:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:3.0:1789518119.578160:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1789518119.578377:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627462656:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789518119.578437:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518119.578493:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627462656 00000100:00100000:2.0:1789518119.578543:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627462656 00000100:00100000:2.0:1789518119.578655:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789518119.578665:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff6f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627462656:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789518119.578690:0:6648:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1789518119.578719:0:6648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa9e122, atime: 0x6aa9e122, ctime: 0x6aa9e122, blocks: 0x1 00010000:00010000:2.0:1789518119.578727:0:6648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040d4af35/0x631fd8698c780ebd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518119.578742:0:6648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=173s v=(0 0) 00010000:00010000:2.0:1789518119.578746:0:6648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518119.578752:0:6648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040d4af35/0x631fd8698c780ebd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518119.578768:0:6648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040d4af35/0x631fd8698c780ebd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518119.578785:0:6648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040d4af35/0x631fd8698c780ebd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518119.578790:0:6648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040d4af35/0x631fd8698c780ebd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518119.578804:0:6648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518119.578823:0:7596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518119.578830:0:7596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040d4af35/0x631fd8698c780ebd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518119.578838:0:7596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29c9200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518119.578842:0:7596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040d4af35/0x631fd8698c780ebd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518119.578851:0:7596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040d4af35/0x631fd8698c780ebd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518119.578977:0:7596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040d4af35/0x631fd8698c780ebd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518119.578985:0:7596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040d4af35/0x631fd8698c780ebd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518119.579005:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518119.579007:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518119.579008:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518119.579276:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff6f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3283:x1876445627462656:12345-0@lo:6:osp-syn-1-0.0 Request processed in 612us (838us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789518119.579284:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:1.0:1789518119.579368:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fff7a59180/2, rc 0, transno 4294967300 00000100:00100000:1.0:1789518119.579375:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627462656:0@lo:6:osp-syn-1-0.0 00000100:00080000:3.0:1789518119.579437:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1789518119.667407:0:11633:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789518120.373322:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518121.394899:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518121.586844:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789518121.586866:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff6f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627462784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518121.586924:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518121.587033:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627462784 00000100:00100000:1.0:1789518121.587041:0:6652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627462784 00000100:00080000:3.0:1789518121.587105:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518121.587118:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789518121.587127:0:6652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627462784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789518121.587159:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789518121.587214:0:6652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627462784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518121.587221:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789518121.587279:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff6f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627462784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518121.588802:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff6f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627463168:0@lo:400:kworker.0 00000100:00100000:1.0:1789518121.588844:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518121.588889:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789518121.588895:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff6f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627463040:0@lo:400:kworker.0 00000100:00100000:1.0:1789518121.588915:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518121.588940:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627463168 00000100:00100000:1.0:1789518121.588945:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627463168 00000100:00100000:1.0:1789518121.588986:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627463040 00000100:00100000:1.0:1789518121.588990:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627463040 00000100:00100000:1.0:1789518121.589005:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789518121.589012:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627463168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518121.589236:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627463168:12345-0@lo:400:kworker.0 Request processed in 224us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518121.589243:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789518121.589259:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789518121.589265:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627463040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518121.589290:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627463040:12345-0@lo:400:kworker.0 Request processed in 24us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518121.589295:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1789518121.589312:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518121.589333:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff6f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627463040:0@lo:400:kworker.0 00000100:00100000:1.0:1789518121.589342:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff6f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627463168:0@lo:400:kworker.0 00000100:00100000:2.0:1789518121.589413:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff6f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627463296:0@lo:400:kworker.0 00000100:00100000:2.0:1789518121.589443:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518121.589469:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789518121.589475:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff6f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:824c8f07-28fa-48fd-81af-173b194570e6:3280:1876445627462912:0@lo:400:kworker.0 00000100:00100000:2.0:1789518121.589497:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518121.589517:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff6f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627463424:0@lo:400:kworker.0 00000100:00100000:2.0:1789518121.589534:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518121.589555:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627463424 00000100:00100000:2.0:1789518121.589558:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627463424 00000100:00100000:2.0:1789518121.589599:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789518121.589605:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627463424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518121.589661:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627463424:12345-0@lo:400:kworker.0 Request processed in 55us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518121.589667:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1789518121.589700:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518121.589720:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff6f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627463424:0@lo:400:kworker.0 00000100:00100000:0.0:1789518121.589805:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627462912 00000100:00100000:0.0:1789518121.589809:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627462912 00000100:00100000:0.0:1789518121.589849:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789518121.589864:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc8103050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+19:3280:x1876445627462912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518121.589899:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc8103050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+19:3280:x1876445627462912:12345-0@lo:400:kworker.0 Request processed in 37us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518121.589905:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789518121.589986:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff6f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:824c8f07-28fa-48fd-81af-173b194570e6:3280:1876445627462912:0@lo:400:kworker.0 00000100:00100000:1.0:1789518121.590134:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627463296 00000100:00100000:1.0:1789518121.590139:0:6649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627463296 00000100:00100000:1.0:1789518121.590220:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789518121.590226:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627463296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518121.590269:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627463296:12345-0@lo:400:kworker.0 Request processed in 43us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518121.590285:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1789518121.590376:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffff6f5880 x1876445627463296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518121.590386:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff6f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627463296:0@lo:400:kworker.0 00000100:00080000:2.0:1789518121.590452:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789518122.418993:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518123.406311:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518123.406412:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616951936 00000100:00100000:0.0:1789518123.406422:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616951936 00000100:00100000:3.0:1789518123.407113:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518123.407240:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616952064 00000100:00100000:0.0:1789518123.407244:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 256 00000100:00100000:1.0:1789518123.407246:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616952064 00000100:00100000:0.0:1789518123.407254:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7646450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+13:2342:x1876445616951936:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518123.407296:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 62 00000100:00100000:1.0:1789518123.407303:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2342:x1876445616952064:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518123.407312:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7646450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+13:2342:x1876445616951936:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 61us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518123.407319:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 256 00000100:00100000:1.0:1789518123.407351:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2342:x1876445616952064:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 41us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518123.407359:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 62 00000100:00080000:3.0:1789518123.407373:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518123.416881:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518123.416920:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518123.416955:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616952320 00000100:00100000:1.0:1789518123.416965:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616952320 00000100:00100000:0.0:1789518123.417023:0:6647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616952192 00000100:00100000:0.0:1789518123.417028:0:6647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616952192 00000100:00100000:1.0:1789518123.417090:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00100000:1.0:1789518123.417101:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2343:x1876445616952320:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518123.417170:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2343:x1876445616952320:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 71us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518123.417177:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00080000:3.0:1789518123.417232:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789518123.417236:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518123.417880:0:6647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:0.0:1789518123.417889:0:6647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2343:x1876445616952192:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518123.417986:0:6647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2343:x1876445616952192:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 98us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518123.417993:0:6647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 38 00010000:00010000:0.0:1789518123.442792:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518123.635113:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627463552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518123.635180:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518123.635236:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627463552 00000100:00100000:2.0:1789518123.635244:0:6652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627463552 00000100:00100000:2.0:1789518123.635487:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789518123.635499:0:6652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627463552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789518123.635531:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789518123.635577:0:6652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627463552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518123.635586:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1789518123.635756:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffff632d80 x1876445627463552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518139 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518123.635773:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627463552:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789518123.635882:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789518124.467770:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789518124.699128:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:1.0:1789518125.491241:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518126.514888:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518126.706963:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:824c8f07-28fa-48fd-81af-173b194570e6:3283:1876445627463680:0@lo:400:kworker.0 00000100:00100000:3.0:1789518126.707026:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518126.707084:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff6f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627464192:0@lo:400:kworker.0 00000100:00100000:3.0:1789518126.707127:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518126.707153:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789518126.707158:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff6f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627464064:0@lo:400:kworker.0 00000100:00100000:3.0:1789518126.707181:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518126.707223:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627463680 00000100:00100000:3.0:1789518126.707230:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627463680 00000100:00100000:3.0:1789518126.707272:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789518126.707280:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7645450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+19:3283:x1876445627463680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518126.707324:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7645450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+19:3283:x1876445627463680:12345-0@lo:400:kworker.0 Request processed in 44us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518126.707331:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789518126.707369:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:824c8f07-28fa-48fd-81af-173b194570e6:3283:1876445627463680:0@lo:400:kworker.0 00000100:00100000:3.0:1789518126.707406:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627463808:0@lo:400:kworker.0 00000100:00100000:3.0:1789518126.707435:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518126.707453:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff6f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627464320:0@lo:400:kworker.0 00000100:00100000:3.0:1789518126.707472:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518126.707488:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518126.707493:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627463936:0@lo:400:kworker.0 00000100:00100000:3.0:1789518126.707509:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518126.707549:0:8784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627464064 00000100:00100000:3.0:1789518126.707552:0:8784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627464064 00000100:00100000:3.0:1789518126.707581:0:8784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627464320 00000100:00100000:3.0:1789518126.707583:0:8784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627464320 00000100:00100000:3.0:1789518126.707601:0:8784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789518126.707607:0:8784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627464064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518126.707657:0:8784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627464064:12345-0@lo:400:kworker.0 Request processed in 50us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518126.707670:0:8784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789518126.707682:0:8784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789518126.707687:0:8784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627464320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518126.707714:0:8784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627464320:12345-0@lo:400:kworker.0 Request processed in 28us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518126.707720:0:8784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1789518126.707735:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789518126.707739:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518126.707752:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1789518126.707757:0:3280:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fff7a59180, transno 4294967300 00000100:00100000:3.0:1789518126.707767:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff6f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627464320:0@lo:400:kworker.0 00000100:00100000:3.0:1789518126.707774:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518126.707781:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff497b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627464448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518126.707802:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518126.707824:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627464448 00000100:00100000:3.0:1789518126.707828:0:6652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627464448 00000100:00100000:3.0:1789518126.707849:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789518126.707855:0:6652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627464448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789518126.707879:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789518126.707911:0:6652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627464448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518126.707917:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789518126.708231:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff497b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627464448:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1789518126.708257:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffff6f5880 x1876445627464064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518126.708278:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff6f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627464064:0@lo:400:kworker.0 00000100:00100000:3.0:1789518126.708315:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627464192 00000100:00100000:3.0:1789518126.708319:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627464192 00000100:00100000:3.0:1789518126.708348:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627463808 00000100:00100000:3.0:1789518126.708351:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627463808 00000100:00100000:3.0:1789518126.708360:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627463936 00000100:00100000:3.0:1789518126.708363:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627463936 00000100:00100000:3.0:1789518126.708374:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789518126.708379:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff497b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627464192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518126.708409:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff497b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627464192:12345-0@lo:400:kworker.0 Request processed in 30us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518126.708414:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789518126.708423:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789518126.708428:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff497ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627463808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518126.708449:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff497ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627463808:12345-0@lo:400:kworker.0 Request processed in 21us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518126.708453:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789518126.708462:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789518126.708468:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627463936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518126.708490:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627463936:12345-0@lo:400:kworker.0 Request processed in 23us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518126.708495:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1789518126.708510:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518126.708523:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627463936:0@lo:400:kworker.0 00000100:00100000:3.0:1789518126.708531:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627463808:0@lo:400:kworker.0 00000100:00100000:3.0:1789518126.708558:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff6f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627464192:0@lo:400:kworker.0 00010000:00010000:0.0:1789518127.539709:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518128.525424:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518128.525481:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518128.525513:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518128.525555:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518128.525587:0:8784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616952704 00000100:00100000:2.0:1789518128.525595:0:8784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616952704 00000100:00100000:1.0:1789518128.525781:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616952576 00000100:00100000:1.0:1789518128.525785:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616952576 00000100:00100000:1.0:1789518128.525819:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616952832 00000100:00100000:1.0:1789518128.525821:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616952832 00000100:00100000:1.0:1789518128.525837:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 67 00000100:00100000:1.0:1789518128.525844:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2343:x1876445616952576:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518128.525900:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2343:x1876445616952576:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 57us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518128.525919:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 67 00000100:00100000:1.0:1789518128.525934:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 68 00000100:00100000:1.0:1789518128.525938:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2343:x1876445616952832:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518128.525957:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2343:x1876445616952832:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 19us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518128.525962:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 68 00000100:00100000:0.0:1789518128.526193:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616952448 00000100:00100000:0.0:1789518128.526198:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616952448 00000100:00100000:0.0:1789518128.526231:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 258 00000100:00100000:0.0:1789518128.526239:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7644c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+13:2342:x1876445616952448:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518128.526269:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7644c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+13:2342:x1876445616952448:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 32us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518128.526275:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 258 00000100:00100000:2.0:1789518128.526562:0:8784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:2.0:1789518128.526571:0:8784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2342:x1876445616952704:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518128.526639:0:8784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2342:x1876445616952704:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 44us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518128.526646:0:8784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00080000:3.0:1789518128.527435:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789518128.527441:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789518128.563634:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518128.755242:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff633100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627464576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518128.755314:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518128.755351:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627464576 00000100:00100000:3.0:1789518128.755370:0:6652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627464576 00000100:00100000:3.0:1789518128.755422:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789518128.755428:0:6652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627464576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789518128.755454:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789518128.755466:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518128.755494:0:6652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627464576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518128.755500:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1789518128.755529:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffff633100 x1876445627464576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518144 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518128.755546:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff633100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627464576:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789518129.586860:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789518129.908779:0:11633:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789518130.613316:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518131.635479:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518131.826943:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518131.827054:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627464832:0@lo:400:kworker.0 00000100:00100000:2.0:1789518131.827117:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518131.827166:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789518131.827172:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627464960:0@lo:400:kworker.0 00000100:00100000:2.0:1789518131.827195:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518131.827240:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627464832 00000100:00100000:2.0:1789518131.827247:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627464832 00000100:00100000:2.0:1789518131.827297:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627464960 00000100:00100000:2.0:1789518131.827300:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627464960 00000100:00100000:2.0:1789518131.827341:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789518131.827349:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627464832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518131.827398:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627464832:12345-0@lo:400:kworker.0 Request processed in 50us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518131.827405:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789518131.827422:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789518131.827428:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627464960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518131.827456:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627464960:12345-0@lo:400:kworker.0 Request processed in 28us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518131.827462:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1789518131.827482:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518131.827511:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627464960:0@lo:400:kworker.0 00000100:00100000:2.0:1789518131.827522:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627464832:0@lo:400:kworker.0 00000100:00100000:3.0:1789518131.828470:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789518131.828483:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627465088:0@lo:400:kworker.0 00000100:00100000:3.0:1789518131.828522:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518131.828557:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627465088 00000100:00100000:3.0:1789518131.828562:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627465088 00000100:00100000:3.0:1789518131.828596:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789518131.828603:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff497b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627465088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518131.828655:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff497b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627465088:12345-0@lo:400:kworker.0 Request processed in 53us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518131.828661:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1789518131.828692:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fff7a59880 x1876445627465088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518131.828702:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627465088:0@lo:400:kworker.0 00000100:00100000:3.0:1789518131.828924:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627465216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518131.828950:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789518131.828984:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518131.828999:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627465216 00000100:00100000:3.0:1789518131.829003:0:6651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627465216 00000100:00100000:3.0:1789518131.829041:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789518131.829048:0:6651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff497b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627465216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789518131.829073:0:6651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789518131.829107:0:6651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff497b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627465216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518131.829113:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1789518131.829131:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518131.829150:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627465216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518131.829216:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:824c8f07-28fa-48fd-81af-173b194570e6:3282:1876445627464704:0@lo:400:kworker.0 00000100:00100000:1.0:1789518131.829247:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518131.829722:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789518131.829732:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627465344:0@lo:400:kworker.0 00000100:00100000:0.0:1789518131.829760:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518131.829816:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627465344 00000100:00100000:0.0:1789518131.829821:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627465344 00000100:00100000:0.0:1789518131.829854:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789518131.829860:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627465344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518131.829897:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627465344:12345-0@lo:400:kworker.0 Request processed in 37us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518131.829903:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789518131.829929:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627465344:0@lo:400:kworker.0 00000100:00080000:0.0:1789518131.829942:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518131.830112:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627464704 00000100:00100000:3.0:1789518131.830116:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627464704 00000100:00100000:3.0:1789518131.830183:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789518131.830190:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7644050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+19:3282:x1876445627464704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518131.830233:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7644050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+19:3282:x1876445627464704:12345-0@lo:400:kworker.0 Request processed in 43us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518131.830240:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789518131.830584:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:824c8f07-28fa-48fd-81af-173b194570e6:3282:1876445627464704:0@lo:400:kworker.0 00010000:00010000:3.0:1789518132.658849:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518133.650289:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518133.650373:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518133.650468:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616953088 00000100:00100000:2.0:1789518133.650476:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616953088 00000100:00080000:0.0:1789518133.650601:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518133.650815:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:2.0:1789518133.650827:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff6f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2344:x1876445616953088:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518133.650925:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff6f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2344:x1876445616953088:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 100us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518133.650932:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:3.0:1789518133.651479:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616952960 00000100:00100000:3.0:1789518133.651486:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616952960 00000100:00100000:3.0:1789518133.651556:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 260 00000100:00100000:3.0:1789518133.651564:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7644450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+13:2344:x1876445616952960:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518133.651608:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7644450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+13:2344:x1876445616952960:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 45us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518133.651635:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 260 00000100:00100000:1.0:1789518133.658025:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518133.658325:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616953344 00000100:00100000:0.0:1789518133.658336:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616953344 00000100:00100000:0.0:1789518133.658647:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:0.0:1789518133.658656:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff6f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2344:x1876445616953344:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518133.658779:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff6f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2344:x1876445616953344:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 122us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518133.658788:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00080000:3.0:1789518133.660231:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518133.663080:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518133.663261:0:6647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616953216 00000100:00100000:0.0:1789518133.663271:0:6647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616953216 00000100:00100000:0.0:1789518133.663374:0:6647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:0.0:1789518133.663387:0:6647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff6f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2341:x1876445616953216:12345-192.168.206.51@tcp:9:kworker.0 00000020:00000080:0.0:1789518133.663419:0:6647:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c780df9 00000100:00080000:0.0:1789518133.663431:0:6647:0:(import.c:65:import_set_state_nolock()) ffff99ffc6bd9800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789518133.663487:0:6647:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:1.0:1789518133.663608:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518133.663817:0:6647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff6f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+2:2341:x1876445616953216:12345-192.168.206.51@tcp:9:kworker.0 Request processed in 432us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518133.663824:0:6647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00080000:3.0:1789518133.664178:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789518133.684597:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518133.876010:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627465472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518133.876085:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518133.876206:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627465472 00000100:00100000:1.0:1789518133.876214:0:6651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627465472 00000100:00100000:1.0:1789518133.876278:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789518133.876287:0:6651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627465472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789518133.876321:0:6651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789518133.876368:0:6651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627465472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518133.876392:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1789518133.876434:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffff630e00 x1876445627465472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518149 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518133.876450:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627465472:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789518133.876995:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789518134.707046:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789518134.965907:0:7607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cfa1c47d-1425-4fe5-be2a-28ad5152a12d 00000020:00000080:3.0:1789518134.965915:0:7607:0:(genops.c:885:class_export_put()) final put ffff99ffc6bde800/cfa1c47d-1425-4fe5-be2a-28ad5152a12d 00000020:00000080:0.0:1789518134.965980:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc6bde800/cfa1c47d-1425-4fe5-be2a-28ad5152a12d for lustre-OST0001 00000020:00000080:0.0:1789518134.966034:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffc6bd9800 for lustre-OST0001 00010000:00010000:3.0:1789518135.732323:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518136.755899:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518136.947248:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627465728:0@lo:400:kworker.0 00000100:00100000:0.0:1789518136.947342:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518136.947434:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627465856:0@lo:400:kworker.0 00000100:00100000:3.0:1789518136.947470:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518136.947519:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627465728 00000100:00100000:3.0:1789518136.947530:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627465728 00000100:00100000:2.0:1789518136.947602:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627465856 00000100:00100000:2.0:1789518136.947608:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627465856 00000100:00100000:1.0:1789518136.947689:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789518136.947718:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789518136.947719:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627465728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518136.947735:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc5569c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627466240:0@lo:400:kworker.0 00000100:00100000:2.0:1789518136.947737:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc556bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627465856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518136.947771:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789518136.947791:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518136.947832:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc556bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627465856:12345-0@lo:400:kworker.0 Request processed in 103us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518136.947841:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627465728:12345-0@lo:400:kworker.0 Request processed in 135us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518136.947852:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789518136.947863:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789518136.947900:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc5569880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627465984:0@lo:400:kworker.0 00000100:00100000:0.0:1789518136.947925:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627466240 00000100:00100000:0.0:1789518136.947932:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627466240 00000100:00100000:2.0:1789518136.947938:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518136.947952:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:824c8f07-28fa-48fd-81af-173b194570e6:3282:1876445627465600:0@lo:400:kworker.0 00000100:00100000:0.0:1789518136.947983:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627465984 00000100:00100000:0.0:1789518136.947990:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627465984 00000100:00100000:2.0:1789518136.947994:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789518136.948020:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627466240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518136.948034:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518136.948041:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789518136.948053:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627465984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518136.948090:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627466240:12345-0@lo:400:kworker.0 Request processed in 73us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518136.948101:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789518136.948116:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627465600 00000100:00100000:1.0:1789518136.948126:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627465600 00000100:00100000:0.0:1789518136.948138:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627465984:12345-0@lo:400:kworker.0 Request processed in 85us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518136.948152:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789518136.948153:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627465856:0@lo:400:kworker.0 00000100:00080000:2.0:1789518136.948159:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789518136.948165:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518136.948194:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff633100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627466368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518136.948197:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00010000:00080000:2.0:1789518136.948219:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffc5569880 x1876445627465984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518136.948222:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7647850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+19:3282:x1876445627465600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518136.948247:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518136.948252:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc5569880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627465984:0@lo:400:kworker.0 00000100:00100000:0.0:1789518136.948255:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc5569c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627466240:0@lo:400:kworker.0 00000100:00100000:0.0:1789518136.948279:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627465728:0@lo:400:kworker.0 00000100:00100000:1.0:1789518136.948310:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7647850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+19:3282:x1876445627465600:12345-0@lo:400:kworker.0 Request processed in 96us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518136.948317:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627466368 00000100:00100000:1.0:1789518136.948320:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789518136.948325:0:6651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627466368 00000100:00100000:0.0:1789518136.948357:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:824c8f07-28fa-48fd-81af-173b194570e6:3282:1876445627465600:0@lo:400:kworker.0 00000100:00100000:0.0:1789518136.948367:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc556aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627466112:0@lo:400:kworker.0 00000100:00100000:2.0:1789518136.948385:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789518136.948395:0:6651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc556ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627466368:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518136.948404:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518136.948692:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627466112 00000100:00100000:1.0:1789518136.948699:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627466112 00000100:00100000:1.0:1789518136.948759:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789518136.948767:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876445627466112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518136.948812:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876445627466112:12345-0@lo:400:kworker.0 Request processed in 46us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518136.948833:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789518136.948878:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc556aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627466112:0@lo:400:kworker.0 00000100:00080000:0.0:1789518136.948963:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00000024:2.0:1789518136.949117:0:6651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789518136.949322:0:6651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc556ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627466368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 926us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518136.949332:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789518136.949341:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff633100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627466368:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789518137.779783:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518138.766769:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518138.766824:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518138.766956:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616953600 00000100:00100000:0.0:1789518138.767040:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616953600 00000100:00100000:0.0:1789518138.767237:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:0.0:1789518138.767249:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff6f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2344:x1876445616953600:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518138.767345:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff6f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2344:x1876445616953600:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 99us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518138.767354:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00080000:1.0:1789518138.767640:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518138.768006:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616953472 00000100:00100000:2.0:1789518138.768015:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616953472 00000100:00100000:2.0:1789518138.768099:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 262 00000100:00100000:2.0:1789518138.768108:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7645850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+13:2345:x1876445616953472:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518138.768166:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7645850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+13:2345:x1876445616953472:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 59us (1413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518138.768173:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 262 00000100:00100000:1.0:1789518138.770189:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518138.770535:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616953728 00000100:00100000:3.0:1789518138.770557:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616953728 00000100:00100000:3.0:1789518138.770707:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:3.0:1789518138.770719:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff6f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2345:x1876445616953728:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518138.770803:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff6f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2345:x1876445616953728:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 87us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518138.770812:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00080000:1.0:1789518138.771586:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789518138.803732:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518138.998059:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff630000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627466496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518138.998127:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518138.998268:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627466496 00000100:00100000:3.0:1789518138.998288:0:6652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627466496 00000100:00100000:3.0:1789518138.998353:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789518138.998363:0:6652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627466496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789518138.998392:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789518138.998519:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518138.998724:0:6652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627466496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 362us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518138.998732:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1789518138.998826:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffff630000 x1876445627466496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518154 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518138.998845:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff630000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627466496:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1789518139.123646:0:11633:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:2.0:1789518139.737892:0:11802:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 20:22:19 (1789518139) 00010000:00010000:3.0:1789518139.827324:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518140.776529:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518140.776665:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616953856 00000100:00100000:2.0:1789518140.776675:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616953856 00000100:00100000:2.0:1789518140.776741:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:2.0:1789518140.776752:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:10195:x1876445616953856:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518140.776770:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518140.776791:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8400/0x631fd8698c780ec4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc713 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518140.776850:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8600/0x631fd8698c780ecb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518140.776863:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8600/0x631fd8698c780ecb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518140.776893:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8600/0x631fd8698c780ecb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518140.776928:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789518140.776932:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518140.776968:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8600/0x631fd8698c780ecb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518140.777009:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8400/0x631fd8698c780ec4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc713 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518140.777039:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8600/0x631fd8698c780ecb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc713 expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518140.777047:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2ad3600) 00010000:00010000:2.0:1789518140.777050:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518140.777053:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29c8600, rc 0) 00000100:00100000:2.0:1789518140.777111:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:10195:x1876445616953856:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 361us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518140.777119:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00080000:1.0:1789518140.777549:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518140.786237:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518140.786326:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616953984 00000100:00100000:1.0:1789518140.786335:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616953984 00000100:00100000:1.0:1789518140.786390:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:1.0:1789518140.786400:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:10196:x1876445616953984:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518140.786419:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518140.786438:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c780ed2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc71a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518140.786493:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c780ed9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518140.786507:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c780ed9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518140.786517:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c780ed9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518140.786530:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c780ee0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518140.786546:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c780ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518140.786553:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c780ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518140.788006:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c780ee7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518140.788894:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c780ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518140.788914:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c780ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518140.788953:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789518140.788957:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518140.788992:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c780ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518140.789004:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c780ed9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518140.789011:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c780ed9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518140.789018:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c780ed9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518140.789024:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f6400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518140.789037:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c780ed9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518140.789056:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c780ed9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518140.789073:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2ad3600) 00010000:00010000:1.0:1789518140.789076:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518140.789081:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c780ed9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518140.789089:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c780ed9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518140.789102:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c780ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518140.789108:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c780ee0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518140.789114:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c780ee0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518140.789119:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518140.789122:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c780ee0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518140.789128:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c780ee0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518140.789135:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff99ffc2fdc000) 00010000:00010000:1.0:1789518140.789137:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518140.789140:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c780ee0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518140.789156:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c780ee0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518140.789195:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c780ed2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc71a expref: 8 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518140.789209:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c780ee7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc71a expref: 7 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518140.789216:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99ffc2fdc100) 00010000:00010000:1.0:1789518140.789218:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518140.789220:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f6c00, rc 0) 00000100:00100000:1.0:1789518140.790239:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:10196:x1876445616953984:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 3833us (4004us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518140.790249:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:1.0:1789518140.799192:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518140.799340:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616954240 00000100:00100000:2.0:1789518140.799350:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616954240 00000100:00100000:2.0:1789518140.799404:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:2.0:1789518140.799414:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:10196:x1876445616954240:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518140.799434:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518140.799452:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8400/0x631fd8698c780eee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc721 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518140.799552:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8000/0x631fd8698c780ef5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518140.799565:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8000/0x631fd8698c780ef5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518140.799575:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8000/0x631fd8698c780ef5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518140.799669:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c780efc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518140.799677:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c780efc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518140.799684:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c780efc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518140.800001:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c780f03 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518140.800010:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c780f03 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518140.800016:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c780f03 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518140.800025:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1789518140.800160:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8000/0x631fd8698c780ef5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518140.800168:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8000/0x631fd8698c780ef5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518140.800181:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8000/0x631fd8698c780ef5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518140.800188:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29c8000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518140.800191:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8000/0x631fd8698c780ef5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518140.800199:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8000/0x631fd8698c780ef5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518140.800210:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99ffc2fdc100) 00010000:00010000:2.0:1789518140.800213:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518140.800217:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8000/0x631fd8698c780ef5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518140.800222:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8000/0x631fd8698c780ef5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518140.800239:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c780efc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518140.800245:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c780efc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518140.800250:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c780efc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518140.800255:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29c9200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518140.800257:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c780efc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518140.800273:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c780efc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518140.800280:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99ffc2ad3900) 00010000:00010000:2.0:1789518140.800283:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518140.800286:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c780efc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518140.800291:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c780efc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518140.800772:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8400/0x631fd8698c780eee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc721 expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518140.800788:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c780f03 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc721 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518140.800795:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffc2ad3d00) 00010000:00010000:2.0:1789518140.800798:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518140.800800:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696400, rc 0) 00000100:00100000:2.0:1789518140.800872:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+9:10196:x1876445616954240:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1459us (1687us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789518140.800880:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:2.0:1789518140.805776:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518140.805963:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616954368 00000100:00100000:3.0:1789518140.805973:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616954368 00000100:00100000:3.0:1789518140.806150:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:3.0:1789518140.806162:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+9:10196:x1876445616954368:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789518140.806268:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+9:10196:x1876445616954368:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 Request processed in 108us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518140.806276:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 34 00010000:00010000:1.0:1789518140.862747:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518141.171254:0:11633:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789518141.875226:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518142.067204:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:824c8f07-28fa-48fd-81af-173b194570e6:3282:1876445627466624:0@lo:400:kworker.0 00000100:00100000:1.0:1789518142.067264:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518142.067306:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627467136:0@lo:400:kworker.0 00000100:00100000:1.0:1789518142.067331:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518142.067354:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789518142.067360:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627466752:0@lo:400:kworker.0 00000100:00100000:1.0:1789518142.067382:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518142.067401:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627467264:0@lo:400:kworker.0 00000100:00100000:1.0:1789518142.067435:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518142.067462:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627467008:0@lo:400:kworker.0 00000100:00100000:1.0:1789518142.067485:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518142.067501:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789518142.067506:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627466880:0@lo:400:kworker.0 00000100:00100000:1.0:1789518142.067527:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518142.067553:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627466624 00000100:00100000:1.0:1789518142.067559:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627466624 00000100:00100000:1.0:1789518142.067599:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789518142.067607:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7645050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+19:3282:x1876445627466624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518142.067678:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7645050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+19:3282:x1876445627466624:12345-0@lo:400:kworker.0 Request processed in 71us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518142.067685:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789518142.067713:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627467136 00000100:00100000:1.0:1789518142.067716:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627467136 00000100:00100000:1.0:1789518142.067743:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627466752 00000100:00100000:1.0:1789518142.067746:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627466752 00000100:00100000:1.0:1789518142.067755:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627466880 00000100:00100000:1.0:1789518142.067757:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627466880 00000100:00100000:1.0:1789518142.067770:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789518142.067776:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876445627467136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518142.067805:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876445627467136:12345-0@lo:400:kworker.0 Request processed in 29us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518142.067811:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789518142.067928:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789518142.067937:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627466752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518142.067991:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627466752:12345-0@lo:400:kworker.0 Request processed in 56us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518142.067997:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789518142.068011:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789518142.068017:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627466880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518142.068049:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627466880:12345-0@lo:400:kworker.0 Request processed in 33us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518142.068055:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789518142.068072:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627467264 00000100:00100000:2.0:1789518142.068076:0:6649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627467264 00000100:00100000:2.0:1789518142.068101:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627467008 00000100:00100000:2.0:1789518142.068104:0:6649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627467008 00000100:00100000:2.0:1789518142.068125:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789518142.068131:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627467264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518142.068159:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627467264:12345-0@lo:400:kworker.0 Request processed in 28us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518142.068165:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789518142.068176:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789518142.068182:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627467008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518142.068207:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627467008:12345-0@lo:400:kworker.0 Request processed in 25us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518142.068212:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789518142.068251:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627466880:0@lo:400:kworker.0 00010000:00080000:2.0:1789518142.068261:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fff79af800 x1876445627467008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789518158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518142.068270:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627467008:0@lo:400:kworker.0 00000100:00100000:2.0:1789518142.069249:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627467392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518142.069286:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518142.069317:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627467392 00000100:00100000:2.0:1789518142.069322:0:6651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627467392 00000100:00100000:2.0:1789518142.069348:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789518142.069355:0:6651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627467392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789518142.069379:0:6651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789518142.069412:0:6651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627467392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518142.069419:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789518142.069450:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627467392:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789518142.069531:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789518142.069535:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789518142.069538:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518142.069562:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627466752:0@lo:400:kworker.0 00000100:00100000:1.0:1789518142.069583:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627467264:0@lo:400:kworker.0 00000100:00100000:1.0:1789518142.069591:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:824c8f07-28fa-48fd-81af-173b194570e6:3282:1876445627466624:0@lo:400:kworker.0 00000100:00100000:1.0:1789518142.069599:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627467136:0@lo:400:kworker.0 00000100:00100000:3.0:1789518142.219798:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518142.219878:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616954496 00000100:00100000:0.0:1789518142.219887:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616954496 00000100:00100000:0.0:1789518142.219957:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:0.0:1789518142.219967:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc556a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+9:10238:x1876445616954496:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518142.219996:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518142.220014:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c780f11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc728 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518142.220071:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c780f18 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518142.220084:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c780f18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518142.220096:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c780f18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518142.220111:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c780f1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518142.220118:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c780f1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518142.220136:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c780f1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518142.220309:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c780f18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518142.220317:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c780f18 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518142.220337:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c780f18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518142.220344:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518142.220349:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c780f18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518142.220356:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c780f18 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518142.220369:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2ad3600) 00010000:00010000:0.0:1789518142.220372:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518142.220376:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c780f18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518142.220383:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c780f18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518142.220394:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c780f1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518142.220400:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c780f1f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518142.220413:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c780f1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518142.220418:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bdc00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518142.220421:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c780f1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518142.220428:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c780f1f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518142.220437:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff99ffd2a17e00) 00010000:00010000:0.0:1789518142.220439:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518142.220442:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c780f1f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518142.220447:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c780f1f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518142.220480:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c780f11 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc728 expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518142.220490:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2ad3600) 00010000:00010000:0.0:1789518142.220492:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518142.220496:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c780f11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc728 expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518142.220504:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd600, rc 0) 00000100:00100000:0.0:1789518142.220575:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc556a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+9:10238:x1876445616954496:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 609us (784us total) trans 0 rc 301/301 00000100:00100000:0.0:1789518142.220589:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00080000:3.0:1789518142.220897:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518142.227277:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518142.227352:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616954752 00000100:00100000:3.0:1789518142.227362:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616954752 00000100:00100000:3.0:1789518142.227416:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:3.0:1789518142.227425:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+9:10238:x1876445616954752:12345-192.168.206.51@tcp:36:lfs.0 00010000:00010000:3.0:1789518142.227473:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518142.227494:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8600/0x631fd8698c780ecb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc713 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.227512:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2ad3600) 00010000:00010000:3.0:1789518142.227521:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518142.227749:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c780f26 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.227763:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c780f26 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.227779:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c780f26 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.227790:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c780f2d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.227797:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c780f2d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.227803:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c780f2d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518142.228567:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789518142.228577:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c780f26 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.228585:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c780f26 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.228591:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c780f26 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.228597:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518142.228602:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c780f26 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.228609:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c780f26 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.228640:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffd8781600) 00010000:00010000:3.0:1789518142.228644:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518142.228654:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c780f26 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.228661:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c780f26 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518142.228676:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000076a2620a reply state 000000008974c7cf transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c780f2d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518142.228685:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789518142.228779:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+10:10238:x1876445616954752:12345-192.168.206.51@tcp:36:lfs.0 Request processed in 1353us (1509us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789518142.228787:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 36 00010000:00010000:1.0:1789518142.231811:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c780f2d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.231825:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c780f2d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.231833:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c780f2d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.231838:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518142.231843:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c780f2d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.231850:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c780f2d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.231864:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff99ffd8781b00) 00010000:00010000:1.0:1789518142.231867:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518142.231872:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c780f2d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.231879:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c780f2d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518142.310224:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518142.311161:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616954880 00000100:00100000:2.0:1789518142.311173:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616954880 00000100:00100000:2.0:1789518142.311231:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00100000:2.0:1789518142.311242:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+9:10246:x1876445616954880:12345-192.168.206.51@tcp:101:lctl.0 00010000:00010000:2.0:1789518142.311263:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518142.311284:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c780f34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc72f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.311496:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c780f3b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.311510:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c780f3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.311520:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c780f3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518142.311568:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789518142.311572:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518142.311608:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c780f3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.311672:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c780f34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc72f expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.311688:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c780f3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc72f expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.311695:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2ad3000) 00010000:00010000:2.0:1789518142.311698:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518142.311701:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697e00, rc 0) 00000100:00100000:3.0:1789518142.311989:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+10:10246:x1876445616954880:12345-192.168.206.51@tcp:101:lctl.0 Request processed in 747us (1770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518142.311997:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00100000:0.0:1789518142.366801:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518142.366868:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616955008 00000100:00100000:3.0:1789518142.366877:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616955008 00000100:00100000:3.0:1789518142.366929:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:3.0:1789518142.366939:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+10:10252:x1876445616955008:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:3.0:1789518142.366957:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518142.366988:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c780f42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc736 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.367046:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c780f49 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.367060:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c780f49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.367070:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c780f49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.367097:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c780f50 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.367104:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c780f50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.367111:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c780f50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.367199:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c780f57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.367206:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c780f57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.367212:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c780f57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518142.367237:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789518142.367240:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518142.367272:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c780f57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.367283:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c780f49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.367289:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c780f49 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.367296:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c780f49 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.367311:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518142.367315:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c780f49 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.367322:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c780f49 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.367334:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2ad3000) 00010000:00010000:3.0:1789518142.367337:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518142.367342:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c780f49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.367347:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c780f49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.367359:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c780f50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.367365:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c780f50 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.367371:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c780f50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.367376:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518142.367391:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c780f50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.367398:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c780f50 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.367414:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff99ffd8781600) 00010000:00010000:3.0:1789518142.367417:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518142.367420:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c780f50 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.367426:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c780f50 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.367454:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c780f42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc736 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.367465:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c780f57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc736 expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.367473:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ffd8781a00) 00010000:00010000:3.0:1789518142.367475:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789518142.367477:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16400, rc 0) 00000100:00100000:3.0:1789518142.367541:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+11:10252:x1876445616955008:12345-192.168.206.51@tcp:101:bash.0 Request processed in 603us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518142.367547:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:0.0:1789518142.373510:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518142.374442:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616955264 00000100:00100000:1.0:1789518142.374453:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616955264 00000100:00100000:1.0:1789518142.374564:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 39 00000100:00100000:1.0:1789518142.374575:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+11:10252:x1876445616955264:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:1.0:1789518142.374593:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518142.374646:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7c00/0x631fd8698c780f5e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc73d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.374750:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c780f65 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.374763:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c780f65 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.374774:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c780f65 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.374825:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c780f6c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.374833:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c780f6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.374840:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c780f6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789518142.375326:0:5812:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1789518142.375463:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c780f73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.375478:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c780f73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.375487:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c780f73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.375522:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c780f65 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.375529:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c780f65 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.375536:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c780f65 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.375543:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f6e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518142.375547:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c780f65 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.375555:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c780f65 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.375566:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ffd8781a00) 00010000:00010000:1.0:1789518142.375569:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518142.375573:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c780f65 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.375579:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c780f65 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789518142.375590:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ed8321b reply state 000000000811e694 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c780f6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518142.375598:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789518142.375662:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7c00/0x631fd8698c780f5e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc73d expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.375687:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c780f73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc73d expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.375695:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffc2fdca00) 00010000:00010000:1.0:1789518142.375697:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789518142.375700:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f6600, rc 0) 00000100:00100000:1.0:1789518142.375762:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+14:10252:x1876445616955264:12345-192.168.206.51@tcp:101:bash.0 Request processed in 1189us (2260us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1789518142.375769:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 39 00010000:00010000:3.0:1789518142.377455:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c780f6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.377471:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c780f6c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.377480:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c780f6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.377500:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518142.377505:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c780f6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.377513:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c780f6c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.377537:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99ffc2fdc200) 00010000:00010000:3.0:1789518142.377540:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518142.377544:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c780f6c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.377550:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c780f6c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518142.380246:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518142.380320:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616955392 00000100:00100000:2.0:1789518142.380329:0:6649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616955392 00000100:00100000:2.0:1789518142.380372:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:2.0:1789518142.380380:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2341:x1876445616955392:12345-192.168.206.51@tcp:8:bash.0 00010000:00080000:2.0:1789518142.380408:0:6649:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from cfa1c47d-1425-4fe5-be2a-28ad5152a12d@192.168.206.51@tcp t0 exp 0000000000000000 cur 196 last 0 00000020:00000080:2.0:1789518142.380435:0:6649:0:(genops.c:1384:class_connect()) connect: client cfa1c47d-1425-4fe5-be2a-28ad5152a12d, cookie 0x631fd8698c780f81 00002000:00100000:2.0:1789518142.380445:0:6649:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cfa1c47d-1425-4fe5-be2a-28ad5152a12d/ffff99ffd80fa800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789518142.380465:0:6649:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789518142.380804:0:6649:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789518142.380831:0:6649:0:(import.c:65:import_set_state_nolock()) ffff99ffd80f8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789518142.380983:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2341:x1876445616955392:12345-192.168.206.51@tcp:8:bash.0 Request processed in 601us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518142.381014:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:1.0:1789518142.387374:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518142.387461:0:6647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616955520 00000100:00100000:2.0:1789518142.387469:0:6647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616955520 00000100:00100000:2.0:1789518142.387542:0:6647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:2.0:1789518142.387551:0:6647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:0:x1876445616955520:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1789518142.387566:0:6647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518142.387585:0:6647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8a4f941/0x631fd8698c780f88 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc744 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518142.387608:0:6647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518142.387657:0:6647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=196s v=(0 0) 00010000:00010000:2.0:1789518142.387662:0:6647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518142.387671:0:6647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8a4f941/0x631fd8698c780f88 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc744 expref: 7 pid: 6647 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.387699:0:6647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d8a4f941/0x631fd8698c780f88 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc744 expref: 7 pid: 6647 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.387711:0:6647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697000, rc 0) 00000100:00100000:2.0:1789518142.387760:0:6647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:0:x1876445616955520:12345-192.168.206.51@tcp:101:bash.0 Request processed in 210us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518142.387766:0:6647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00080000:3.0:1789518142.388369:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518142.393769:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518142.393872:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616955648 00000100:00100000:2.0:1789518142.393881:0:6649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616955648 00000100:00100000:2.0:1789518142.393931:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:2.0:1789518142.393940:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5569f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:10252:x1876445616955648:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1789518142.393965:0:6649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518142.393995:0:6649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c780f8f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc74b expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.394022:0:6649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8a4f941/0x631fd8698c780f88 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc744 expref: 8 pid: 6647 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.394032:0:6649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518142.394036:0:6649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518142.394041:0:6649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c780f8f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc74b expref: 8 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.394074:0:6649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d8a4f941/0x631fd8698c780f88 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc744 expref: 8 pid: 6647 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.394087:0:6649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d8a4f941/0x631fd8698c780f88 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc744 expref: 8 pid: 6647 timeout: 296 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518142.394099:0:6649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff631500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6649:1876445627467520:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518142.394277:0:6649:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbbf300 going to sleep for 11 seconds 00000100:00100000:2.0:1789518142.400180:0:6649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff631500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6649:1876445627467520:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518142.400212:0:6649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c780f8f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc74b expref: 8 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.400230:0:6649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696600, rc 0) 00000100:00100000:2.0:1789518142.400290:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5569f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+8:10252:x1876445616955648:12345-192.168.206.51@tcp:101:bash.0 Request processed in 6351us (6529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518142.400298:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:1.0:1789518142.403234:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518142.403853:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616955776 00000100:00100000:2.0:1789518142.403864:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616955776 00010000:00010000:2.0:1789518142.403914:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d8a4f941/0x631fd8698c780f88 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc744 expref: 8 pid: 6647 timeout: 296 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518142.403952:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:2.0:1789518142.403961:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0793100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+8:2345:x1876445616955776:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518142.403985:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518142.404301:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d8a4f941/0x631fd8698c780f88 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc744 expref: 8 pid: 6647 timeout: 296 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.404315:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d8a4f941/0x631fd8698c780f88 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc744 expref: 8 pid: 6647 timeout: 296 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.404445:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8a4f941/0x631fd8698c780f88 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc744 expref: 8 pid: 6647 timeout: 296 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.404459:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518142.404463:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518142.404471:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c780f8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc74b expref: 7 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.404479:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c780f8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc74b expref: 7 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.404789:0:5797:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c780f8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc74b expref: 7 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518142.404803:0:5797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff631500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5797:1876445627467648:192.168.206.51@tcp:105: 00000100:00100000:2.0:1789518142.404881:0:5797:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbbf300 going to sleep for 11 seconds 00000100:00100000:2.0:1789518142.408878:0:5797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff631500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5797:1876445627467648:192.168.206.51@tcp:105: 00010000:00010000:2.0:1789518142.408912:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518142.408954:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0793100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:2345:x1876445616955776:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 4993us (5728us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518142.408964:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:1.0:1789518142.413756:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518142.413853:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616956032 00000100:00100000:2.0:1789518142.413863:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616956032 00000100:00100000:2.0:1789518142.413929:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:2.0:1789518142.413938:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+13:10252:x1876445616956032:12345-192.168.206.51@tcp:35:bash.0 00000100:00100000:2.0:1789518142.414291:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+14:10252:x1876445616956032:12345-192.168.206.51@tcp:35:bash.0 Request processed in 352us (543us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789518142.414299:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:1.0:1789518142.491001:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518142.491088:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616956288 00000100:00100000:3.0:1789518142.491097:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616956288 00000100:00100000:3.0:1789518142.491159:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 40 00000100:00100000:3.0:1789518142.491168:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0790e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+14:10262:x1876445616956288:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518142.491190:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518142.491503:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c780f96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc752 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518142.492013:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789518142.492132:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c780f96 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc752 expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.492145:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2ad3000) 00010000:00010000:2.0:1789518142.492148:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789518142.492153:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c780f96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc752 expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.492179:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16c00, rc 0) 00000100:00100000:2.0:1789518142.492319:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0790e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+15:10262:x1876445616956288:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1150us (1326us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1789518142.492327:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 40 00000100:00100000:0.0:1789518142.497100:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518142.497187:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616956544 00000100:00100000:3.0:1789518142.497197:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616956544 00000100:00100000:3.0:1789518142.497253:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:3.0:1789518142.497263:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+15:10262:x1876445616956544:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:3.0:1789518142.497473:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+16:10262:x1876445616956544:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 210us (380us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1789518142.497481:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:1.0:1789518142.547556:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518142.547734:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616956672 00000100:00100000:3.0:1789518142.547744:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616956672 00000100:00100000:2.0:1789518142.547927:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:2.0:1789518142.547937:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+16:10268:x1876445616956672:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518142.547959:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518142.547991:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c780fa4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc759 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.548059:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c780fab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.548072:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c780fab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.548083:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c780fab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518142.548112:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789518142.548116:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518142.548131:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c780fab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.548154:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c780fa4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc759 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.548188:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c780fab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc759 expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.548196:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ffd8781a00) 00010000:00010000:2.0:1789518142.548199:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518142.548202:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697400, rc 0) 00000100:00100000:2.0:1789518142.548267:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+17:10268:x1876445616956672:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 332us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518142.548275:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:1.0:1789518142.554899:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518142.555101:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616956928 00000100:00100000:0.0:1789518142.555111:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616956928 00000100:00100000:0.0:1789518142.555168:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:0.0:1789518142.555177:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+17:10268:x1876445616956928:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518142.555196:0:8051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518142.555215:0:8051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c780fb2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc760 expref: -99 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518142.555298:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c780fb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518142.555312:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c780fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518142.555323:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c780fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518142.555333:0:8051:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789518142.555447:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c780fb2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc760 expref: 20 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518142.555481:0:8051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c780fb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc760 expref: 19 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518142.555488:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffc2fdca00) 00010000:00010000:0.0:1789518142.555491:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518142.555494:0:8051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd000, rc 0) 00000100:00100000:0.0:1789518142.555941:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+19:10268:x1876445616956928:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 436us (730us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1789518142.555951:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:0.0:1789518142.558441:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518142.558557:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616957184 00000100:00100000:1.0:1789518142.558565:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616957184 00000100:00100000:1.0:1789518142.558635:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 43 00000100:00100000:1.0:1789518142.558644:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+19:10268:x1876445616957184:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518142.558665:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518142.558682:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c780fc7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc767 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.558763:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c780fce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.558793:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c780fce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.558804:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c780fce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518142.558817:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789518142.558928:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c780fc7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc767 expref: 22 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.558946:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c780fce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc767 expref: 21 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.558954:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffc2fdca00) 00010000:00010000:1.0:1789518142.558957:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789518142.558960:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f7800, rc 0) 00000100:00100000:1.0:1789518142.559022:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+21:10268:x1876445616957184:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 379us (587us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1789518142.559030:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 43 00000100:00100000:1.0:1789518142.559701:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518142.559815:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616957312 00000100:00100000:3.0:1789518142.559821:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616957312 00000100:00100000:3.0:1789518142.559864:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:3.0:1789518142.559872:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff667800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+21:2345:x1876445616957312:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518142.559883:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518142.559907:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c780fb9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc760 expref: 21 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.559921:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffc2fdca00) 00010000:00010000:3.0:1789518142.559924:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518142.559949:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff667800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+20:2345:x1876445616957312:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 79us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518142.559956:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:1.0:1789518142.567536:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518142.567727:0:6647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616957440 00000100:00100000:2.0:1789518142.568143:0:6647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616957440 00000100:00100000:2.0:1789518142.568246:0:6647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:2.0:1789518142.568256:0:6647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff667b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:2343:x1876445616957440:12345-192.168.206.51@tcp:1:lfs.0 00010000:00010000:2.0:1789518142.568296:0:6647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8a4f941/0x631fd8698c780fdc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.568315:0:6647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c780f8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc74b expref: 7 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.568324:0:6647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518142.568328:0:6647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518142.568333:0:6647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8a4f941/0x631fd8698c780fdc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.568363:0:6647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c780f8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc74b expref: 7 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.568453:0:6647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c780f8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc74b expref: 7 pid: 6649 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518142.568468:0:6647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff631500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6647:1876445627467776:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518142.568608:0:6647:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbbf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518142.571772:0:6647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff631500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6647:1876445627467776:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518142.571798:0:6647:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d8a4f941/0x631fd8698c780fdc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518142.572435:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518142.572518:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616957568 00000100:00100000:0.0:1789518142.572530:0:6653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616957568 00002000:00100000:0.0:1789518142.572567:0:6653:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff99ffff666d80 x1876445616957568/t0(0) o4->cfa1c47d-1425-4fe5-be2a-28ad5152a12d@192.168.206.51@tcp:543/0 lens 504/0 e 0 to 0 dl 1789518153 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518142.572578:0:6653:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffff666d80 with x1876445616957568 ext(0->12) 00010000:00010000:0.0:1789518142.572584:0:6653:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c780f8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc74b expref: 8 pid: 6649 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518142.572598:0:6653:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c780f8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc74b expref: 8 pid: 6649 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518142.572605:0:6653:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99ffff666d80 00000100:00100000:0.0:1789518142.572653:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:0.0:1789518142.572662:0:6653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+8:2342:x1876445616957568:12345-192.168.206.51@tcp:4:lfs.0 00000001:00100000:2.0:1789518142.604464:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cfa1c47d-1425-4fe5-be2a-28ad5152a12d 00000100:00100000:0.0:1789518142.605889:0:6653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+9:2342:x1876445616957568:12345-192.168.206.51@tcp:4:lfs.0 Request processed in 33220us (33449us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789518142.605901:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00002000:00100000:0.0:1789518142.605913:0:6653:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff99ffff666d80 x1876445616957568/t4294967299(0) o4->cfa1c47d-1425-4fe5-be2a-28ad5152a12d@192.168.206.51@tcp:543/0 lens 504/448 e 0 to 0 dl 1789518153 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518142.605924:0:6653:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffff666d80 with x1876445616957568 ext(0->12) 00010000:00010000:0.0:1789518142.605933:0:6653:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c780f8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc74b expref: 9 pid: 6649 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518142.605951:0:6653:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c780f8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc74b expref: 9 pid: 6649 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518142.605959:0:6653:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99ffff666d80 00000100:00100000:1.0:1789518142.610504:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518142.610602:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616957696 00000100:00100000:3.0:1789518142.610641:0:5798:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616957696 00010000:00010000:3.0:1789518142.610676:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c780f8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc74b expref: 9 pid: 6649 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518142.610706:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:3.0:1789518142.610715:0:5798:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff664700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+9:2343:x1876445616957696:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518142.610728:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789518142.610758:0:5798:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789518142.610761:0:5798:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789518143 00002000:00010000:3.0:1789518142.610763:0:5798:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789518143 00002000:00010000:3.0:1789518142.610765:0:5798:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789518143 00010000:00010000:3.0:1789518142.610772:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c780f8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc74b expref: 9 pid: 6649 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.610785:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c780f8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc74b expref: 9 pid: 6649 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.610807:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c780f8f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc74b expref: 9 pid: 6649 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.610822:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789518142.610827:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789518142.610832:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8a4f941/0x631fd8698c780fdc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.610854:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8a4f941/0x631fd8698c780fdc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.610883:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518142.611648:0:5798:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff664700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+8:2343:x1876445616957696:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 931us (1148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518142.611657:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 36 00010000:00010000:3.0:1789518142.611684:0:6647:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d8a4f941/0x631fd8698c780fdc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.611705:0:6647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8a4f941/0x631fd8698c780fdc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.611730:0:6647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8a4f941/0x631fd8698c780fdc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.611739:0:6647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8a4f941/0x631fd8698c780fdc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.611746:0:6647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8a4f941/0x631fd8698c780fdc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.611753:0:6647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518142.611757:0:6647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8a4f941/0x631fd8698c780fdc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.611766:0:6647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8a4f941/0x631fd8698c780fdc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.611778:0:6647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8a4f941/0x631fd8698c780fdc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.611785:0:6647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8a4f941/0x631fd8698c780fdc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518142.611840:0:6647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff667b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:2343:x1876445616957440:12345-192.168.206.51@tcp:1:lfs.0 Request processed in 43586us (44313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518142.611848:0:6647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:0.0:1789518142.614149:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518142.614207:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616957952 00000100:00100000:3.0:1789518142.614215:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616957952 00000100:00100000:3.0:1789518142.614304:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:3.0:1789518142.614314:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+20:10268:x1876445616957952:12345-192.168.206.51@tcp:35:lfs.0 00000004:00010000:3.0:1789518142.614367:0:5815:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c780fce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc767 expref: 20 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789518142.614706:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1789518142.614756:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1789518142.615408:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1789518142.615461:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c780fe3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.615477:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c780f73 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc73d expref: 24 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.615486:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c780fe3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.615515:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c780f73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc73d expref: 24 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.616623:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c780f73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc73d expref: 24 pid: 5812 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518142.616654:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc556b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5815:1876445627467904:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518142.616744:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbb5600 going to sleep for 11 seconds 00000100:00100000:3.0:1789518142.620138:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc556b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5815:1876445627467904:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518142.620140:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:3.0:1789518142.620165:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c780fe3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518142.620330:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616958080 00000100:00100000:2.0:1789518142.620338:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616958080 00010000:00010000:2.0:1789518142.620371:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c780f73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc73d expref: 25 pid: 5812 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518142.620410:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00100000:2.0:1789518142.620419:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff665c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+25:2343:x1876445616958080:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518142.620432:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518142.620438:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c780f73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc73d expref: 25 pid: 5812 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.620450:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c780f73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc73d expref: 25 pid: 5812 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.620484:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c780f73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc73d expref: 25 pid: 5812 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.620498:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffc2fdca00) 00010000:00010000:2.0:1789518142.620502:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c780fe3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.620511:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c780fe3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.620518:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c780fe3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.620597:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518142.620670:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff665c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+24:2343:x1876445616958080:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 251us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518142.620678:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 37 00010000:00010000:3.0:1789518142.622025:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c780fe3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.622037:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c780fe3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789518142.622147:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1789518142.622318:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1789518142.622435:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc556b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1876445627468032:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789518142.622482:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518142.622515:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbb50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518142.622760:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627468032 00000100:00100000:2.0:1789518142.622766:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627468032 00000100:00100000:2.0:1789518142.622809:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789518142.622817:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc556b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5815:x1876445627468032:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789518142.622889:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc556b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5815:x1876445627468032:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 73us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518142.622896:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789518142.623093:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc556b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1876445627468032:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789518142.623679:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1789518142.623732:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc556b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1876445627468160:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789518142.623764:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518142.623782:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbb5600 going to sleep for 11 seconds 00000100:00100000:2.0:1789518142.623922:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627468160 00000100:00100000:2.0:1789518142.623927:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627468160 00000100:00100000:2.0:1789518142.623959:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789518142.623966:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5815:x1876445627468160:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789518142.624121:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5815:x1876445627468160:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 155us (356us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789518142.624128:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789518142.624428:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc556b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1876445627468160:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789518142.624468:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1789518142.624498:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c780fe3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.624514:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c780fe3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.624533:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c780fe3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.624540:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518142.624545:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c780fe3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.624553:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c780fe3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.624566:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffc2fdca00) 00010000:00010000:3.0:1789518142.624569:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789518142.624573:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c780fe3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.624579:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c780fe3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789518142.624749:0:5815:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789518142.625013:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1789518142.625023:0:5815:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 196621408801ns, next at 197621407083ns, rc = 0 00000001:00080000:3.0:1789518142.625029:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1789518142.625057:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffc2fdca00) 00010000:00010000:3.0:1789518142.625060:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789518142.625066:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c780fce lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc767 expref: 28 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518142.625214:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+27:10268:x1876445616957952:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 10901us (11073us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1789518142.625222:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00000020:00080000:3.0:1789518142.625226:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789518142.628251:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518142.628351:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616958208 00000100:00100000:0.0:1789518142.628360:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616958208 00000100:00100000:0.0:1789518142.628440:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:0.0:1789518142.628450:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+27:10268:x1876445616958208:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518142.628470:0:8051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518142.628489:0:8051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c780fea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc76e expref: -99 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518142.628550:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c780fea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc76e expref: 28 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518142.628565:0:8051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c780fea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc76e expref: 28 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518142.628596:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffd2a17e00) 00010000:00010000:0.0:1789518142.628599:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518142.628602:0:8051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc400, rc 0) 00000100:00100000:1.0:1789518142.628823:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+28:10268:x1876445616958208:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 373us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518142.628839:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:1.0:1789518142.631778:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518142.631832:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616958464 00000100:00100000:2.0:1789518142.631841:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616958464 00000100:00100000:2.0:1789518142.631925:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:2.0:1789518142.631935:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfa73050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+28:10268:x1876445616958464:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:2.0:1789518142.632146:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfa73050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+29:10268:x1876445616958464:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 212us (374us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1789518142.632153:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:0.0:1789518142.673137:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518142.673237:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616958720 00000100:00100000:1.0:1789518142.673247:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616958720 00000100:00100000:1.0:1789518142.673308:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 45 00000100:00100000:1.0:1789518142.673318:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+29:10278:x1876445616958720:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518142.673354:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518142.673373:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c780ff1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc775 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518142.673462:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1789518142.673573:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c780ff1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc775 expref: 31 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.673588:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2ad3000) 00010000:00010000:1.0:1789518142.673591:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789518142.673997:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c780ff1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc775 expref: 31 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.674062:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f7600, rc 0) 00000100:00100000:1.0:1789518142.674157:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+30:10278:x1876445616958720:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 840us (1027us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1789518142.674164:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 45 00000100:00100000:1.0:1789518142.677354:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518142.677422:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616958848 00000100:00100000:2.0:1789518142.677432:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616958848 00000100:00100000:2.0:1789518142.677485:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 46 00000100:00100000:2.0:1789518142.677500:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+30:10278:x1876445616958848:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:2.0:1789518142.677578:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c780fff lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.677600:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c780fff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.677648:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c780fff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.677665:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781006 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.677673:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781006 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.677697:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781006 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.677782:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78100d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.677790:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78100d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.677796:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78100d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518142.677911:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78100d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.677924:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c780fff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.677930:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c780fff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.677937:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c780fff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.677953:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518142.677958:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c780fff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.677964:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c780fff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.677986:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ffd8781a00) 00010000:00010000:2.0:1789518142.677994:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518142.678001:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c780fff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.678007:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c780fff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.678020:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781006 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.678025:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781006 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.678031:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781006 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.678037:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518142.678040:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781006 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.678045:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781006 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.678053:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99ffc2ad3f00) 00010000:00010000:2.0:1789518142.678055:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518142.678058:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781006 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.678063:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781006 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.678077:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78100d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.678090:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78100d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.678096:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78100d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.678101:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518142.678104:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78100d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.678109:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78100d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.678116:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffd2a17e00) 00010000:00010000:2.0:1789518142.678119:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518142.678121:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78100d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.678126:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78100d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518142.678197:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+30:10278:x1876445616958848:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 703us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518142.678204:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 46 00000100:00100000:0.0:1789518142.680837:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518142.681066:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616959104 00000100:00100000:3.0:1789518142.681076:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616959104 00000100:00100000:3.0:1789518142.681168:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:3.0:1789518142.681179:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+30:10278:x1876445616959104:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:3.0:1789518142.681379:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+31:10278:x1876445616959104:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 202us (549us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1789518142.681387:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:0.0:1789518142.712278:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518142.712375:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616959360 00000100:00100000:2.0:1789518142.712384:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616959360 00000100:00100000:2.0:1789518142.712441:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:2.0:1789518142.712450:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+31:10281:x1876445616959360:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518142.712773:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518142.712805:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c781014 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc77c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.712873:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c78101b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.712889:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c78101b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.712899:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c78101b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.712913:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c781022 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.712920:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c781022 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.712927:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c781022 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.713147:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781029 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.713156:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781029 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.713162:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781029 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518142.713172:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789518142.713250:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c78101b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.713262:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c78101b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.713266:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c78101b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.713270:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518142.713273:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c78101b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.713278:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c78101b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.713286:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ffd8781a00) 00010000:00010000:2.0:1789518142.713288:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518142.713291:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c78101b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.713294:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c78101b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.713303:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c781022 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.713306:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c781022 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.713310:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c781022 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.713312:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518142.713317:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c781022 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.713321:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c781022 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.713325:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99ffc2ad3f00) 00010000:00010000:2.0:1789518142.713326:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518142.713328:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c781022 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.713331:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c781022 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.713359:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c781014 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc77c expref: 34 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.713367:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781029 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc77c expref: 33 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.713371:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffd2a17e00) 00010000:00010000:2.0:1789518142.713372:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518142.713373:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696200, rc 0) 00000100:00100000:2.0:1789518142.713429:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+33:10281:x1876445616959360:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 979us (1159us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1789518142.713436:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:1.0:1789518142.717236:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518142.717360:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616959488 00000100:00100000:2.0:1789518142.717369:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616959488 00000100:00100000:2.0:1789518142.717424:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:2.0:1789518142.717435:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+33:10281:x1876445616959488:12345-192.168.206.51@tcp:54:lfs.0 00010000:00010000:2.0:1789518142.717512:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781037 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.717528:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781037 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.717539:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781037 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.717563:0:8051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781037 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.717570:0:8051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781037 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.717577:0:8051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781037 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.717583:0:8051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518142.717587:0:8051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781037 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.717594:0:8051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781037 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.717604:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffd2a17e00) 00010000:00010000:2.0:1789518142.717607:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789518142.717647:0:8051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781037 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.717655:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781037 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518142.717838:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+33:10281:x1876445616959488:12345-192.168.206.51@tcp:54:lfs.0 Request processed in 405us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518142.717850:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:0.0:1789518142.720029:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518142.720197:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616959744 00000100:00100000:2.0:1789518142.720206:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616959744 00000100:00100000:2.0:1789518142.720295:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:2.0:1789518142.720305:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+33:10281:x1876445616959744:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:2.0:1789518142.720504:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+34:10281:x1876445616959744:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 200us (483us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1789518142.720511:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:0.0:1789518142.894418:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518142.894843:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616960000 00000100:00100000:1.0:1789518142.894864:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616960000 00000100:00100000:1.0:1789518142.895066:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:1.0:1789518142.895075:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+34:10312:x1876445616960000:12345-192.168.206.51@tcp:101:cat.0 00010000:00010000:1.0:1789518142.895104:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518142.895125:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c78103e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc783 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.895243:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c781045 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.895259:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c781045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.895273:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c781045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518142.895285:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789518142.895461:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c78103e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc783 expref: 37 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.895478:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c781045 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc783 expref: 36 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.895484:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffd2a17e00) 00010000:00010000:1.0:1789518142.895487:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789518142.895490:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f6200, rc 0) 00000100:00100000:1.0:1789518142.896215:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+36:10312:x1876445616960000:12345-192.168.206.51@tcp:101:cat.0 Request processed in 1136us (1807us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1789518142.896224:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 49 00010000:00010000:0.0:1789518142.898847:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518142.899841:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518142.899886:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518142.899895:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616960128 00000100:00100000:2.0:1789518142.899908:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616960128 00000100:00100000:2.0:1789518142.900161:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:2.0:1789518142.900174:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd8065450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+36:2344:x1876445616960128:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518142.900218:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518142.900248:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c781045 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc783 expref: 36 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.900269:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffd2a17e00) 00010000:00010000:2.0:1789518142.900275:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518142.900384:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd8065450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+35:2344:x1876445616960128:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 213us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518142.900393:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:3.0:1789518142.900514:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616960384 00000100:00100000:3.0:1789518142.900531:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616960384 00000100:00100000:3.0:1789518142.900644:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:3.0:1789518142.900655:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+35:10312:x1876445616960384:12345-192.168.206.51@tcp:35:cat.0 00000100:00100000:3.0:1789518142.900988:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+36:10312:x1876445616960384:12345-192.168.206.51@tcp:35:cat.0 Request processed in 335us (1101us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1789518142.900996:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:1.0:1789518142.943777:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518142.943887:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616960640 00000100:00100000:2.0:1789518142.943904:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616960640 00000100:00100000:2.0:1789518142.944027:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00100000:2.0:1789518142.944039:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4000a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+36:10318:x1876445616960640:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:2.0:1789518142.944072:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518142.944075:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789518142.944108:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c780fab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc759 expref: 36 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.944133:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ffd8781a00) 00010000:00010000:2.0:1789518142.944139:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518142.944155:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781053 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc78a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.944281:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78105a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.944301:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781029 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc77c expref: 36 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.944310:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78105a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.944349:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781029 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc77c expref: 36 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.944365:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781029 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc77c expref: 36 pid: 5811 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518142.944381:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff631500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1876445627468288:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518142.944512:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc2d8ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518142.952509:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518142.952562:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff631500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1876445627468288:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518142.952592:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616960768 00010000:00010000:2.0:1789518142.952600:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78105a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518142.952603:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616960768 00010000:00010000:3.0:1789518142.952791:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781029 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc77c expref: 37 pid: 5811 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518142.952830:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:3.0:1789518142.952838:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+37:2343:x1876445616960768:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518142.952871:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518142.952880:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781029 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc77c expref: 37 pid: 5811 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.952894:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781029 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc77c expref: 37 pid: 5811 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.952919:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781029 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc77c expref: 37 pid: 5811 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.952936:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffd2a17e00) 00010000:00010000:3.0:1789518142.952946:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78105a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.952958:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78105a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.952978:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78105a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518142.953013:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518142.953090:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+36:2343:x1876445616960768:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 251us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518142.953100:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 38 00010000:00010000:2.0:1789518142.953422:0:5813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78105a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.953431:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78105a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518142.953454:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789518142.953683:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781053 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc78a expref: 37 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.953708:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78105a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc78a expref: 36 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.953716:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffd2a17e00) 00010000:00010000:2.0:1789518142.953719:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789518142.953722:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697c00, rc 0) 00000100:00100000:2.0:1789518142.953767:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4000a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+36:10318:x1876445616960640:12345-192.168.206.51@tcp:101:dd.0 Request processed in 9731us (9999us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1789518142.953775:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00100000:0.0:1789518142.958199:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518142.958251:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616961024 00000100:00100000:2.0:1789518142.958266:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616961024 00000100:00100000:2.0:1789518142.958506:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 51 00000100:00100000:2.0:1789518142.958519:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+36:10318:x1876445616961024:12345-192.168.206.51@tcp:36:dd.0 00010000:00010000:2.0:1789518142.958992:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c781068 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.959015:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c781068 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518142.959030:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c781068 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789518142.959102:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1789518142.959132:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000097eca785 reply state 00000000f450c1c5 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c781068 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518142.959143:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518142.959285:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+39:10318:x1876445616961024:12345-192.168.206.51@tcp:36:dd.0 Request processed in 766us (1092us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1789518142.959294:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 51 00000020:00080000:2.0:1789518142.959304:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789518142.962013:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c781068 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.962173:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c781068 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.962183:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c781068 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.962191:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518142.962196:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c781068 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.962206:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c781068 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.962227:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffd2a17e00) 00010000:00010000:1.0:1789518142.962231:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518142.962237:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c781068 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518142.962243:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c781068 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518143.127148:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518143.127220:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616961152 00000100:00100000:1.0:1789518143.127233:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616961152 00000100:00100000:1.0:1789518143.127402:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 52 00000100:00100000:1.0:1789518143.127414:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+38:10332:x1876445616961152:12345-192.168.206.51@tcp:101:stat.0 00010000:00010000:1.0:1789518143.127463:0:8051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518143.127488:0:8051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c78106f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc791 expref: -99 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.127560:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781076 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.127577:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781076 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.127593:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781076 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.127610:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c78107d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.127666:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c78107d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.127673:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c78107d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.127773:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c781084 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.127784:0:8051:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78105a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc78a expref: 39 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.127794:0:8051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c781084 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.127831:0:8051:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78105a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc78a expref: 39 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.127857:0:8051:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78105a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc78a expref: 39 pid: 5813 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518143.127874:0:8051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4002a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8051:1876445627468416:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518143.127997:0:8051:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbbf3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518143.131555:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518143.131679:0:8051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4002a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8051:1876445627468416:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518143.131710:0:8051:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c781084 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518143.131800:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616961408 00000100:00100000:2.0:1789518143.131808:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616961408 00000100:00100000:2.0:1789518143.131899:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:2.0:1789518143.131910:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+40:5577:x1876445616961408:12345-192.168.206.51@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789518143.132303:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+41:5577:x1876445616961408:12345-192.168.206.51@tcp:35:ldlm_bl.0 Request processed in 394us (758us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1789518143.132312:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:0.0:1789518143.134898:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518143.135480:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616961536 00000100:00100000:1.0:1789518143.135493:0:5798:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616961536 00010000:00010000:1.0:1789518143.135545:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78105a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc78a expref: 41 pid: 5813 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518143.135595:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 39 00000100:00100000:1.0:1789518143.135606:0:5798:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+41:2343:x1876445616961536:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518143.135652:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518143.135660:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78105a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc78a expref: 41 pid: 5813 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.135687:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78105a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc78a expref: 41 pid: 5813 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.135715:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78105a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc78a expref: 41 pid: 5813 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.135756:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffd2a17e00) 00010000:00010000:1.0:1789518143.135762:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c781084 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.135773:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c781084 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.135782:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c781084 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.135822:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518143.135887:0:5798:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+40:2343:x1876445616961536:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 282us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518143.135895:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 39 00010000:00010000:3.0:1789518143.136122:0:8051:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c781084 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518143.136131:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c781084 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518143.136194:0:8051:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789518143.136198:0:8051:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518143.136241:0:8051:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c781084 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518143.136254:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c781084 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518143.136265:0:8051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781076 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518143.136272:0:8051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781076 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518143.136280:0:8051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781076 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518143.136286:0:8051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f6800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518143.136291:0:8051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781076 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518143.136299:0:8051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781076 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518143.136309:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ffd8781a00) 00010000:00010000:3.0:1789518143.136312:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518143.136316:0:8051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781076 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518143.136322:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781076 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518143.136344:0:8051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c78107d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518143.136351:0:8051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c78107d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518143.136357:0:8051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c78107d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518143.136362:0:8051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f6a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518143.136365:0:8051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c78107d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518143.136371:0:8051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c78107d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518143.136377:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99ffc2fdc400) 00010000:00010000:3.0:1789518143.136380:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518143.136382:0:8051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c78107d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518143.136388:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c78107d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518143.136426:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c78106f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc791 expref: 40 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518143.136440:0:8051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c781084 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc791 expref: 39 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518143.136458:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffd2a17e00) 00010000:00010000:3.0:1789518143.136460:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518143.136463:0:8051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f7200, rc 0) 00000100:00100000:3.0:1789518143.136504:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+39:10332:x1876445616961152:12345-192.168.206.51@tcp:101:stat.0 Request processed in 9093us (9369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518143.136512:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 52 00000100:00100000:0.0:1789518143.198246:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518143.198591:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616961792 00000100:00100000:1.0:1789518143.198603:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616961792 00000100:00100000:1.0:1789518143.198697:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 53 00000100:00100000:1.0:1789518143.198709:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+39:10338:x1876445616961792:12345-192.168.206.51@tcp:36:truncate.0 00010000:00010000:1.0:1789518143.198776:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518143.198811:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c781084 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc791 expref: 39 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.198832:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffd2a17e00) 00010000:00010000:1.0:1789518143.198839:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518143.199102:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c78108b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.199118:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c78108b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.199153:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c78108b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789518143.199211:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1789518143.199239:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009afd5782 reply state 0000000022e24ff8 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c78108b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518143.199249:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789518143.199383:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+41:10338:x1876445616961792:12345-192.168.206.51@tcp:36:truncate.0 Request processed in 676us (1150us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1789518143.199391:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 53 00000020:00080000:1.0:1789518143.199397:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789518143.206006:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c78108b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518143.206027:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c78108b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518143.206036:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c78108b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518143.206043:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518143.206048:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c78108b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518143.206056:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c78108b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518143.206074:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffd2a17e00) 00010000:00010000:3.0:1789518143.206078:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518143.206083:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c78108b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518143.206090:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c78108b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518143.336993:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518143.337641:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616961920 00000100:00100000:2.0:1789518143.337653:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616961920 00000100:00100000:2.0:1789518143.337712:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 54 00000100:00100000:2.0:1789518143.337722:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+40:10352:x1876445616961920:12345-192.168.206.51@tcp:101:stat.0 00010000:00010000:2.0:1789518143.337767:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518143.337791:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c781092 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc798 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.337864:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781099 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.337879:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781099 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.337892:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781099 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.337906:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7810a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.337913:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7810a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.337920:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7810a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.338029:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7810a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.338037:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7810a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.338044:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7810a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518143.338088:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1789518143.338098:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518143.338127:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7810a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.338140:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7810a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.338149:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781099 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.338155:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781099 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.338162:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781099 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.338168:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518143.338172:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781099 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.338181:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781099 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.338193:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ffd8781a00) 00010000:00010000:2.0:1789518143.338196:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518143.338201:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781099 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.338207:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781099 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.338220:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7810a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.338235:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7810a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.338242:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7810a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.338246:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518143.338249:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7810a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.338413:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7810a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.338422:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99ffc2ad3f00) 00010000:00010000:2.0:1789518143.338424:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518143.338427:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7810a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.338433:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7810a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.338466:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c781092 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc798 expref: 42 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.338480:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7810a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc798 expref: 41 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.338487:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffd2a17e00) 00010000:00010000:2.0:1789518143.338490:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518143.338500:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696800, rc 0) 00000100:00100000:2.0:1789518143.339723:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+41:10352:x1876445616961920:12345-192.168.206.51@tcp:101:stat.0 Request processed in 1994us (2735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518143.339732:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 54 00000100:00100000:0.0:1789518143.391898:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518143.392290:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616962176 00000100:00100000:1.0:1789518143.392302:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616962176 00000100:00100000:1.0:1789518143.392498:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 55 00000100:00100000:1.0:1789518143.392512:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+41:10362:x1876445616962176:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518143.392539:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518143.392566:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7810ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc79f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518143.392725:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1789518143.392863:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7810ae lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc79f expref: 43 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.392880:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2ad3000) 00010000:00010000:1.0:1789518143.392884:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789518143.392890:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7810ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc79f expref: 43 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.392927:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f7200, rc 0) 00000100:00100000:1.0:1789518143.393015:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+42:10362:x1876445616962176:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 506us (1131us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1789518143.393022:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 55 00000100:00100000:0.0:1789518143.396591:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518143.396778:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616962432 00000100:00100000:3.0:1789518143.396787:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616962432 00000100:00100000:3.0:1789518143.397078:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:3.0:1789518143.397089:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+42:10362:x1876445616962432:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:3.0:1789518143.397431:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+43:10362:x1876445616962432:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 342us (916us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1789518143.397439:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:0.0:1789518143.450243:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518143.450427:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616962688 00000100:00100000:3.0:1789518143.450437:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616962688 00000100:00100000:3.0:1789518143.450496:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 56 00000100:00100000:3.0:1789518143.450506:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+43:10368:x1876445616962688:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:3.0:1789518143.450531:0:8051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518143.450551:0:8051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c7810bc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc7a6 expref: -99 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518143.450789:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7810c3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518143.450804:0:8051:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7810a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc798 expref: 44 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518143.450814:0:8051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7810c3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518143.450846:0:8051:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7810a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc798 expref: 44 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518143.450883:0:8051:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7810a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc798 expref: 44 pid: 5813 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518143.450897:0:8051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc5568700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8051:1876445627468544:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518143.451061:0:8051:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbb59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518143.455177:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518143.455381:0:8051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc5568700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8051:1876445627468544:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518143.455405:0:8051:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7810c3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518143.456202:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616962816 00000100:00100000:2.0:1789518143.456211:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616962816 00010000:00010000:2.0:1789518143.456330:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7810a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc798 expref: 45 pid: 5813 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518143.456374:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 40 00000100:00100000:2.0:1789518143.456384:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+45:2342:x1876445616962816:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518143.456398:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518143.456405:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7810a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc798 expref: 45 pid: 5813 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.456417:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7810a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc798 expref: 45 pid: 5813 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.456438:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7810a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc798 expref: 45 pid: 5813 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.456453:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffd2a17e00) 00010000:00010000:2.0:1789518143.456458:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7810c3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.456466:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7810c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.456474:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7810c3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.456662:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518143.456724:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+44:2342:x1876445616962816:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 340us (1554us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518143.456732:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 40 00010000:00010000:3.0:1789518143.457724:0:8051:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7810c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518143.457735:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7810c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518143.457753:0:8051:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1789518143.457894:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c7810bc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7a6 expref: 45 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518143.457912:0:8051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7810c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7a6 expref: 44 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518143.457919:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffd2a17e00) 00010000:00010000:3.0:1789518143.457922:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789518143.457924:0:8051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17400, rc 0) 00000100:00100000:3.0:1789518143.457981:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+44:10368:x1876445616962688:12345-192.168.206.51@tcp:101:bash.0 Request processed in 7477us (7747us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1789518143.458001:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 56 00000100:00100000:0.0:1789518143.460375:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518143.461181:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616963072 00000100:00100000:2.0:1789518143.461191:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616963072 00000100:00100000:2.0:1789518143.461294:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00100000:2.0:1789518143.461305:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+44:10368:x1876445616963072:12345-192.168.206.51@tcp:36:bash.0 00010000:00010000:2.0:1789518143.461537:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7810d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.461553:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7810d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.461565:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7810d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789518143.461643:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1789518143.461671:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000019becb5c reply state 00000000251e7467 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7810d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518143.461680:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518143.461756:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+47:10368:x1876445616963072:12345-192.168.206.51@tcp:36:bash.0 Request processed in 452us (1385us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1789518143.461764:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 57 00000020:00080000:2.0:1789518143.461768:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789518143.466212:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:1.0:1789518143.466507:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7810d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.466518:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7810d1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.466526:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7810d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.466532:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518143.466536:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7810d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.466544:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7810d1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.466559:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffd2a17e00) 00010000:00010000:1.0:1789518143.466562:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518143.466566:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7810d1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.466573:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7810d1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518143.466655:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616963200 00000100:00100000:2.0:1789518143.466663:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616963200 00000100:00100000:2.0:1789518143.466715:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 58 00000100:00100000:2.0:1789518143.466734:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+46:10368:x1876445616963200:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1789518143.466755:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518143.466769:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c7810d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc7ad expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.466836:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7810df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.466849:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7810c3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7a6 expref: 47 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.466858:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7810df lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.466888:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7810c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7a6 expref: 47 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.466900:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7810c3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7a6 expref: 47 pid: 8051 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518143.466912:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff631500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1876445627468672:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518143.466993:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8a990c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518143.471548:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff631500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1876445627468672:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518143.471576:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7810df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518143.472685:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518143.472827:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616963328 00000100:00100000:1.0:1789518143.472846:0:5798:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616963328 00010000:00010000:1.0:1789518143.472879:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7810c3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7a6 expref: 48 pid: 8051 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518143.472917:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:1.0:1789518143.472926:0:5798:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+48:2342:x1876445616963328:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518143.472938:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518143.472945:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7810c3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7a6 expref: 48 pid: 8051 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.472956:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7810c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7a6 expref: 48 pid: 8051 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.473416:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7810c3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7a6 expref: 48 pid: 8051 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.473434:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffd2a17e00) 00010000:00010000:1.0:1789518143.473439:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7810df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.473449:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7810df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.473457:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7810df lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.474105:0:5813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7810df lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.474128:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7810df lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.474180:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:2.0:1789518143.474205:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789518143.474211:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518143.474231:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7810df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.474311:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c7810d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7ad expref: 48 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.474326:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7810df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7ad expref: 47 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518143.474332:0:5798:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+47:2342:x1876445616963328:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 1403us (1647us total) trans 0 rc 0/0 00010000:00010000:2.0:1789518143.474339:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffd2a17e00) 00010000:00010000:2.0:1789518143.474342:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518143.474347:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696000, rc 0) 00000100:00100000:1.0:1789518143.474355:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:2.0:1789518143.474377:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+46:10368:x1876445616963200:12345-192.168.206.51@tcp:101:bash.0 Request processed in 7644us (8172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518143.474385:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 58 00000100:00100000:0.0:1789518143.477183:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518143.477285:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616963584 00000100:00100000:2.0:1789518143.477293:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616963584 00000100:00100000:2.0:1789518143.477335:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:2.0:1789518143.477343:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfa73c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+46:10368:x1876445616963584:12345-192.168.206.51@tcp:35:bash.0 00000100:00100000:2.0:1789518143.477521:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfa73c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+47:10368:x1876445616963584:12345-192.168.206.51@tcp:35:bash.0 Request processed in 178us (346us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1789518143.477539:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:0.0:1789518143.532166:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518143.533534:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616963840 00000100:00100000:1.0:1789518143.533546:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616963840 00000100:00100000:0.0:1789518143.537004:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 59 00000100:00100000:0.0:1789518143.537030:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+47:10378:x1876445616963840:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518143.537052:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518143.537071:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c7810e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc7b4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518143.537152:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789518143.537257:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c7810e6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7b4 expref: 49 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518143.537271:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2ad3000) 00010000:00010000:0.0:1789518143.537274:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789518143.537280:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c7810e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7b4 expref: 49 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518143.537293:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc800, rc 0) 00000100:00100000:0.0:1789518143.537408:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+48:10378:x1876445616963840:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 380us (5249us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1789518143.537415:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 59 00000100:00100000:0.0:1789518143.539276:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518143.539382:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616963968 00000100:00100000:1.0:1789518143.539391:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616963968 00000100:00100000:1.0:1789518143.539578:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 60 00000100:00100000:1.0:1789518143.539589:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+48:10378:x1876445616963968:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:1.0:1789518143.539720:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c7810f4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.539735:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c7810f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.539746:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c7810f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.539761:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7c00/0x631fd8698c7810fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.539767:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7c00/0x631fd8698c7810fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.539774:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7c00/0x631fd8698c7810fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.539848:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c781102 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.539856:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c781102 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.539878:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c781102 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789518143.539914:0:8051:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c781102 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.539925:0:8051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c7810f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.539932:0:8051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c7810f4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.540023:0:8051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c7810f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.540031:0:8051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518143.540036:0:8051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c7810f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.540143:0:8051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c7810f4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.540155:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ffd8781a00) 00010000:00010000:1.0:1789518143.540158:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518143.540163:0:8051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c7810f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.540169:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c7810f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.540181:0:8051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7c00/0x631fd8698c7810fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.540194:0:8051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7c00/0x631fd8698c7810fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.540200:0:8051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7c00/0x631fd8698c7810fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.540204:0:8051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518143.540208:0:8051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7c00/0x631fd8698c7810fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.540214:0:8051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7c00/0x631fd8698c7810fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.540222:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99ffc2fdc800) 00010000:00010000:1.0:1789518143.540225:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518143.540228:0:8051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7c00/0x631fd8698c7810fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.540234:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7c00/0x631fd8698c7810fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.540248:0:8051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c781102 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.540254:0:8051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c781102 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.540260:0:8051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c781102 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.540265:0:8051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f6e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518143.540274:0:8051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c781102 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.540281:0:8051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c781102 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.540290:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffd2a17e00) 00010000:00010000:1.0:1789518143.540292:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518143.540295:0:8051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c781102 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.540300:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c781102 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518143.540410:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+48:10378:x1876445616963968:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 821us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518143.540417:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 60 00000100:00100000:1.0:1789518143.543361:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518143.543888:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616964224 00000100:00100000:3.0:1789518143.543897:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616964224 00000100:00100000:3.0:1789518143.543951:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:3.0:1789518143.543962:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4002a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+48:10378:x1876445616964224:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:3.0:1789518143.544526:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4002a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+49:10378:x1876445616964224:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 564us (1170us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1789518143.544534:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:0.0:1789518143.583598:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518143.583915:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616964480 00000100:00100000:2.0:1789518143.583925:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616964480 00000100:00100000:2.0:1789518143.584026:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 61 00000100:00100000:2.0:1789518143.584036:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+49:10381:x1876445616964480:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518143.584059:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518143.584077:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c781109 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc7bb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.584146:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781110 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.584159:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781110 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.584170:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781110 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.584182:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c781117 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.584188:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c781117 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.584194:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c781117 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.584298:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c78111e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.584307:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c78111e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.584332:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c78111e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518143.584342:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789518143.584429:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781110 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.584437:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781110 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.584444:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781110 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.584449:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518143.584454:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781110 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.584461:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781110 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.584472:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ffd8781a00) 00010000:00010000:2.0:1789518143.584475:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518143.584480:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781110 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.584486:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781110 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.584498:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c781117 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.584503:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c781117 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.584515:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c781117 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.584520:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518143.584523:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c781117 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.584529:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c781117 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.584536:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99ffc2ad3f00) 00010000:00010000:2.0:1789518143.584538:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518143.584541:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c781117 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.584545:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c781117 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.584585:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c781109 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7bb expref: 52 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.584598:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c78111e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7bb expref: 51 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.584605:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffd2a17e00) 00010000:00010000:2.0:1789518143.584607:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518143.584609:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696a00, rc 0) 00000100:00100000:2.0:1789518143.585135:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+51:10381:x1876445616964480:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1099us (1544us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1789518143.585153:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 61 00000100:00100000:0.0:1789518143.591743:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518143.591790:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518143.591895:0:7597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616964608 00000100:00100000:1.0:1789518143.591905:0:7597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616964608 00000100:00100000:1.0:1789518143.592032:0:7597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:1.0:1789518143.592044:0:7597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+51:2345:x1876445616964608:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518143.592060:0:7597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518143.592083:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c78111e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7bb expref: 51 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.592100:0:7597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffd2a17e00) 00010000:00010000:1.0:1789518143.592106:0:7597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518143.592163:0:7597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+50:2345:x1876445616964608:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 121us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518143.592183:0:7597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:2.0:1789518143.593467:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616964736 00000100:00100000:2.0:1789518143.593478:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616964736 00000100:00100000:2.0:1789518143.593534:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 62 00000100:00100000:2.0:1789518143.593543:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+50:10381:x1876445616964736:12345-192.168.206.51@tcp:54:lfs.0 00010000:00010000:2.0:1789518143.593596:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c78112c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.593611:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c78112c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.593649:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c78112c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.593674:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c78112c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.593682:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c78112c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.593689:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c78112c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.593694:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518143.593697:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c78112c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.593705:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c78112c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.593714:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffd2a17e00) 00010000:00010000:2.0:1789518143.593725:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789518143.593730:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c78112c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.593736:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c78112c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518143.593809:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+50:10381:x1876445616964736:12345-192.168.206.51@tcp:54:lfs.0 Request processed in 266us (2019us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518143.593815:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 62 00000100:00100000:0.0:1789518143.597024:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518143.597111:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616964992 00000100:00100000:2.0:1789518143.597120:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616964992 00000100:00100000:2.0:1789518143.597213:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:2.0:1789518143.597222:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+50:10381:x1876445616964992:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:2.0:1789518143.597445:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+51:10381:x1876445616964992:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 224us (428us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1789518143.597454:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:0.0:1789518143.705421:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518143.711108:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616965248 00000100:00100000:2.0:1789518143.711122:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616965248 00000100:00100000:2.0:1789518143.711262:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00100000:2.0:1789518143.711273:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+51:10399:x1876445616965248:12345-192.168.206.51@tcp:101:cat.0 00010000:00010000:2.0:1789518143.711294:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518143.711360:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c781133 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc7c2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.711445:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c78113a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.711458:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c78113a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.711482:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c78113a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518143.711494:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789518143.711644:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c781133 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7c2 expref: 54 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.711667:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c78113a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7c2 expref: 53 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.711676:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffd2a17e00) 00010000:00010000:2.0:1789518143.711679:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789518143.711682:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697a00, rc 0) 00000100:00100000:2.0:1789518143.711746:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+53:10399:x1876445616965248:12345-192.168.206.51@tcp:101:cat.0 Request processed in 475us (6333us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1789518143.711816:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00100000:0.0:1789518143.746003:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518143.746062:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616965376 00000100:00100000:2.0:1789518143.746072:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616965376 00000100:00100000:2.0:1789518143.746134:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 64 00000100:00100000:2.0:1789518143.746144:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+53:10400:x1876445616965376:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518143.746179:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518143.746198:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c781148 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc7c9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.746291:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c78114f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.746330:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c78114f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.746341:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c78114f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518143.746384:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789518143.746388:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518143.746406:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c78114f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.746431:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c781148 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7c9 expref: 55 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.746448:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c78114f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7c9 expref: 54 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.746455:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ffd8781a00) 00010000:00010000:2.0:1789518143.746458:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518143.746461:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697800, rc 0) 00000100:00100000:2.0:1789518143.746518:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+54:10400:x1876445616965376:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 376us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518143.746525:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 64 00000100:00100000:1.0:1789518143.751954:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518143.752783:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616965760 00000100:00100000:3.0:1789518143.752793:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616965760 00000100:00100000:3.0:1789518143.752921:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:3.0:1789518143.752933:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4002680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+54:10400:x1876445616965760:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:3.0:1789518143.753248:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4002680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+55:10400:x1876445616965760:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 317us (1302us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1789518143.753256:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:0.0:1789518143.756136:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518143.756263:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616965888 00000100:00100000:2.0:1789518143.756272:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616965888 00000100:00100000:2.0:1789518143.756391:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:2.0:1789518143.756402:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+55:10400:x1876445616965888:12345-192.168.206.51@tcp:103:lfs.0 00010000:00010000:2.0:1789518143.756417:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789518143.756452:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7810df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7ad expref: 55 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.756472:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c78113a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7c2 expref: 54 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.756484:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c780fea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc76e expref: 53 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.756493:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffd2a17e00) 00010000:00010000:2.0:1789518143.756502:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518143.756555:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+52:10400:x1876445616965888:12345-192.168.206.51@tcp:103:lfs.0 Request processed in 154us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518143.756562:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:0.0:1789518143.759746:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518143.760085:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616966016 00000100:00100000:1.0:1789518143.760094:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616966016 00000100:00100000:1.0:1789518143.760144:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 65 00000100:00100000:1.0:1789518143.760155:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+52:10400:x1876445616966016:12345-192.168.206.51@tcp:58:lfs.0 00010000:00010000:1.0:1789518143.760260:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c781156 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.760275:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c781156 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518143.760287:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c781156 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789518143.761188:0:5811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789518143.761383:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1789518143.761442:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1789518143.761563:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+52:10400:x1876445616966016:12345-192.168.206.51@tcp:58:lfs.0 Request processed in 1408us (1823us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518143.761572:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 65 00000100:00100000:0.0:1789518143.778910:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518143.779183:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616966144 00000100:00100000:2.0:1789518143.779193:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616966144 00000100:00100000:2.0:1789518143.779344:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 66 00000100:00100000:2.0:1789518143.779775:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+52:10402:x1876445616966144:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518143.779793:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518143.779812:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c78115d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc7d0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.779874:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781164 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.779887:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781164 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.779897:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781164 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.779919:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c78116b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.779926:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c78116b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.779932:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c78116b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.780109:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781172 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.780118:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.780124:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518143.780155:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789518143.780158:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518143.780173:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.780183:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.780190:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781164 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.780196:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781164 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.780437:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781164 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.780443:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518143.780447:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781164 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.780455:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781164 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.780465:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ffd8781a00) 00010000:00010000:2.0:1789518143.780468:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518143.780473:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781164 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.780479:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781164 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.780492:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c78116b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.780498:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c78116b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.780503:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c78116b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.780507:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518143.780510:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c78116b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.780592:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c78116b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.780600:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99ffc2ad3f00) 00010000:00010000:2.0:1789518143.780603:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518143.780606:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c78116b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.780684:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c78116b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.780725:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c78115d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7d0 expref: 54 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.780737:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781172 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7d0 expref: 53 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518143.780744:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffc2fdc800) 00010000:00010000:2.0:1789518143.780746:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518143.780749:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696e00, rc 0) 00000100:00100000:2.0:1789518143.780810:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+53:10402:x1876445616966144:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1457us (1907us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518143.780817:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 66 00000100:00100000:0.0:1789518143.885296:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518143.885338:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518143.885377:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518143.885467:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616966272 00000100:00100000:2.0:1789518143.885477:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616966272 00000100:00100000:2.0:1789518143.885541:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 264 00000100:00100000:2.0:1789518143.885551:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7646850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+13:2344:x1876445616966272:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518143.885651:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7646850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+13:2344:x1876445616966272:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 101us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518143.885659:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 264 00000100:00100000:3.0:1789518143.887425:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616966528 00000100:00100000:3.0:1789518143.887436:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616966528 00000100:00100000:3.0:1789518143.887502:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 82 00000100:00100000:3.0:1789518143.887513:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2344:x1876445616966528:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518143.887586:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2344:x1876445616966528:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 75us (2247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518143.887593:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 82 00000100:00080000:2.0:1789518143.888179:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518143.890878:0:8784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616966400 00000100:00100000:1.0:1789518143.890952:0:8784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616966400 00000100:00100000:1.0:1789518143.891704:0:8784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:1.0:1789518143.891716:0:8784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:2344:x1876445616966400:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518143.891833:0:8784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:2344:x1876445616966400:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 119us (6453us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518143.891840:0:8784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 47 00010000:00010000:3.0:1789518143.923261:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518144.116170:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627468800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518144.116305:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789518144.116323:0:7464:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 198112707565ns, next at 199112705212ns, rc = 0 00000100:00100000:1.0:1789518144.116406:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627468800 00000100:00100000:1.0:1789518144.116414:0:6651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627468800 00000100:00100000:1.0:1789518144.116716:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789518144.116726:0:6651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5568700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627468800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789518144.116756:0:6651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789518144.116799:0:6651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5568700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627468800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518144.116806:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1789518144.116867:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518144.116948:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627468800:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1789518144.242781:0:11633:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789518144.242789:0:11633:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518144.242834:0:11633:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789518144.242843:0:11633:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789518144.243030:0:11633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff633100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11633:1876445627468928:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789518144.243118:0:11633:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8a99a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789518144.246056:0:11633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff633100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11633:1876445627468928:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789518144.247075:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518144.247168:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616966656 00000100:00100000:2.0:1789518144.247177:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616966656 00000100:00100000:2.0:1789518144.247276:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:2.0:1789518144.247288:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+53:10413:x1876445616966656:12345-192.168.206.51@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789518144.247360:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+53:10413:x1876445616966656:12345-192.168.206.51@tcp:900:lhsmtool_posix.0 Request processed in 75us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518144.247369:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00080000:0.0:1789518144.248422:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518144.248879:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518144.251815:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616966784 00000100:00100000:1.0:1789518144.251829:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616966784 00000100:00100000:1.0:1789518144.251891:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 67 00000100:00100000:1.0:1789518144.251905:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+53:10413:x1876445616966784:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789518144.251936:0:8051:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789518144.252053:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+53:10413:x1876445616966784:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 152us (3178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518144.252061:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 67 00000100:00100000:2.0:1789518144.257661:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518144.257748:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616966912 00000100:00100000:3.0:1789518144.257757:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616966912 00000100:00100000:3.0:1789518144.257896:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 68 00000100:00100000:3.0:1789518144.257906:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+53:10413:x1876445616966912:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789518144.257979:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781179 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.257994:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781179 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.258007:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781179 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.258060:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781180 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.258068:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781180 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.258075:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781180 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.258112:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c781187 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.258121:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c781187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.258128:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c781187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518144.258186:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789518144.258191:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518144.258205:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c781187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.258215:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781179 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.258221:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781179 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.258228:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781179 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.258233:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518144.258237:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781179 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.258244:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781179 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.258263:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffc2ad3d00) 00010000:00010000:3.0:1789518144.258265:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518144.258270:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781179 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.258275:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781179 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.258286:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781180 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.258301:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781180 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.258307:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781180 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.258312:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518144.258315:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781180 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.258320:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781180 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.258327:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff99ffd8781500) 00010000:00010000:3.0:1789518144.258329:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518144.258331:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781180 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.258335:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781180 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.258345:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c781187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.258349:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c781187 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.258352:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c781187 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.258356:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518144.258362:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c781187 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.258366:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c781187 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.258371:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffc2fdc800) 00010000:00010000:3.0:1789518144.258372:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518144.258374:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c781187 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.258377:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c781187 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518144.258438:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+53:10413:x1876445616966912:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 Request processed in 534us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518144.258444:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 68 00000100:00100000:0.0:1789518144.264239:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518144.264311:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616967168 00000100:00100000:3.0:1789518144.264319:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616967168 00000100:00100000:3.0:1789518144.264366:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 69 00000100:00100000:3.0:1789518144.264471:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+53:10413:x1876445616967168:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518144.264490:0:8051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518144.264508:0:8051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c78118e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc7d7 expref: -99 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.264836:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c781195 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.264851:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c781195 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.264874:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c781195 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518144.265450:0:8051:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789518144.265685:0:8051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c781195 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.265694:0:8051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c781195 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.265700:0:8051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c781195 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.265706:0:8051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518144.265710:0:8051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c781195 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.265717:0:8051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c781195 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.265730:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffc2fdc800) 00010000:00010000:3.0:1789518144.265734:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789518144.265739:0:8051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c781195 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.265745:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c781195 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.265786:0:8051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c78118e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7d7 expref: 55 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.265809:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffc2ad3d00) 00010000:00010000:3.0:1789518144.265812:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789518144.265816:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c78118e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7d7 expref: 55 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.265826:0:8051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17a00, rc 0) 00000100:00100000:3.0:1789518144.265992:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+54:10413:x1876445616967168:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1524us (1758us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1789518144.266000:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 69 00000100:00100000:2.0:1789518144.280002:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518144.281765:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616967296 00000100:00100000:1.0:1789518144.281779:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616967296 00000100:00100000:1.0:1789518144.281834:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 70 00000100:00100000:1.0:1789518144.281844:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+54:10413:x1876445616967296:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789518144.281873:0:5811:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789518144.282056:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+54:10413:x1876445616967296:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 213us (2071us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518144.282064:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 70 00000100:00100000:0.0:1789518144.287041:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518144.288030:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616967552 00000100:00100000:1.0:1789518144.288042:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616967552 00000100:00100000:0.0:1789518144.288128:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 71 00000100:00100000:0.0:1789518144.288141:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+54:10413:x1876445616967552:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518144.288159:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518144.288161:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789518144.288183:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c78114f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7c9 expref: 54 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.288198:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ffd8781a00) 00010000:00010000:0.0:1789518144.288203:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518144.288214:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c7811a3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc7de expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789518144.288587:0:5813:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1789518144.288782:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7811aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.288796:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7811aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.288806:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7811aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.288871:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c7811a3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7de expref: 56 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.289732:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7811aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7de expref: 55 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.289743:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99ffd2a17d00) 00010000:00010000:0.0:1789518144.289746:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518144.289749:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bce00, rc 0) 00000100:00100000:0.0:1789518144.289817:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+55:10413:x1876445616967552:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1680us (2781us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1789518144.289825:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 71 00000100:00100000:0.0:1789518144.296116:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518144.296193:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616967808 00000100:00100000:2.0:1789518144.296202:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616967808 00000100:00100000:2.0:1789518144.296286:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:2.0:1789518144.296304:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+55:10413:x1876445616967808:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789518144.296361:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518144.296385:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7811aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7de expref: 55 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518144.296402:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99ffd2a17d00) 00010000:00010000:2.0:1789518144.296412:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518144.296432:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7811b8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518144.296446:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7811b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518144.296455:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7811b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518144.296488:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7811bf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x9e46798e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518144.296495:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7811bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9e46798e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518144.296503:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7811bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9e46798e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518144.296678:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7811b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518144.296686:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7811b8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518144.296702:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7811b8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518144.296708:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518144.296712:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7811b8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518144.296719:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7811b8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518144.296728:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ffd8781a00) 00010000:00010000:2.0:1789518144.296731:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518144.296734:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7811b8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518144.296739:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7811b8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518144.296748:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7811bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9e46798e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518144.296753:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7811bf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9e46798e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518144.296757:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7811bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9e46798e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518144.296762:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518144.296765:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7811bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9e46798e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518144.296780:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7811bf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9e46798e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518144.296788:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x9e46798e (ffff99ffc2ad3f00) 00010000:00010000:2.0:1789518144.296790:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518144.296793:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7811bf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9e46798e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518144.296799:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7811bf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9e46798e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518144.296889:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+54:10413:x1876445616967808:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 575us (767us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789518144.296898:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:3.0:1789518144.298407:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518144.298437:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616967936 00000100:00100000:3.0:1789518144.298444:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616967936 00000100:00100000:3.0:1789518144.298492:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:3.0:1789518144.298502:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+54:10413:x1876445616967936:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518144.298518:0:8051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518144.298536:0:8051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c7811c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc7e5 expref: -99 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.298567:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7811cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.298579:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7811cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.298588:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7811cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.298696:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c7811c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7e5 expref: 56 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.298710:0:8051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7811cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7e5 expref: 55 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.298718:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99ffd8781500) 00010000:00010000:3.0:1789518144.298720:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789518144.298723:0:8051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17a00, rc 0) 00000100:00100000:3.0:1789518144.298813:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+55:10413:x1876445616967936:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 312us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518144.298820:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:0.0:1789518144.301988:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518144.302914:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616968192 00000100:00100000:2.0:1789518144.302925:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616968192 00000100:00100000:2.0:1789518144.302988:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00100000:2.0:1789518144.302999:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+55:10413:x1876445616968192:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789518144.303257:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c7811d4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518144.303273:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c7811d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518144.303284:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c7811d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789518144.303706:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1789518144.303718:0:5812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 198300103504ns, next at 199300100231ns, rc = 0 00000004:00010000:2.0:1789518144.303950:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ddacd20f reply state 00000000c568ffdf transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c7811d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518144.303971:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518144.304058:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+57:10413:x1876445616968192:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 1060us (2077us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1789518144.304066:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00100000:3.0:1789518144.307111:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:1.0:1789518144.307171:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c7811d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.307183:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c7811d4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.307190:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c7811d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.307196:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518144.307201:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c7811d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.307209:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c7811d4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.307223:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99ffd8781500) 00010000:00010000:1.0:1789518144.307226:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789518144.307231:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c7811d4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.307236:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c7811d4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518144.307534:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616968320 00000100:00100000:2.0:1789518144.307544:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616968320 00000100:00100000:2.0:1789518144.307596:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00100000:2.0:1789518144.307605:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+56:10413:x1876445616968320:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518144.307644:0:8051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518144.307661:0:8051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7811db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc7ec expref: -99 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518144.307708:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7811db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7ec expref: 57 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518144.307722:0:8051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7811db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7ec expref: 57 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518144.307739:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99ffd8781500) 00010000:00010000:2.0:1789518144.307742:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518144.307744:0:8051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696800, rc 0) 00000100:00100000:2.0:1789518144.307793:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+57:10413:x1876445616968320:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 189us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518144.307800:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00100000:1.0:1789518144.309808:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518144.309853:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616968448 00000100:00100000:2.0:1789518144.309867:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616968448 00000100:00100000:2.0:1789518144.309911:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:2.0:1789518144.309918:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4001500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2341:x1876445616968448:12345-192.168.206.51@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1789518144.309946:0:6648:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from cfa1c47d-1425-4fe5-be2a-28ad5152a12d@192.168.206.51@tcp t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:2.0:1789518144.309985:0:6648:0:(genops.c:1384:class_connect()) connect: client cfa1c47d-1425-4fe5-be2a-28ad5152a12d, cookie 0x631fd8698c7811e2 00002000:00100000:2.0:1789518144.309997:0:6648:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cfa1c47d-1425-4fe5-be2a-28ad5152a12d/ffff99ffed829000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789518144.310020:0:6648:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789518144.310253:0:6648:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789518144.310293:0:6648:0:(import.c:65:import_set_state_nolock()) ffff99ffed829800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789518144.310410:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4001500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2341:x1876445616968448:12345-192.168.206.51@tcp:8:lhsmtool_posix.0 Request processed in 490us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518144.310417:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:3.0:1789518144.315314:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518144.315355:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616968576 00000100:00100000:3.0:1789518144.315364:0:6649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616968576 00000100:00100000:3.0:1789518144.315531:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:3.0:1789518144.315546:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc556a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:0:x1876445616968576:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1789518144.315987:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:1.0:1789518144.317049:0:11950:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789518144.317056:0:11950:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518144.317096:0:11950:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789518144.317503:0:11950:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00100000:3.0:1789518144.348587:0:7607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cfa1c47d-1425-4fe5-be2a-28ad5152a12d 00000001:00080000:3.0:1789518144.348605:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:0.0:1789518144.348762:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc556a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:0:x1876445616968576:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 33216us (33453us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789518144.348774:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:1.0:1789518144.350762:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518144.350940:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616968832 00000100:00100000:3.0:1789518144.350950:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616968832 00000100:00100000:3.0:1789518144.351011:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:3.0:1789518144.351021:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4001180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+57:10413:x1876445616968832:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789518144.351240:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4001180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+58:10413:x1876445616968832:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 219us (484us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1789518144.351248:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:1.0:1789518144.353718:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518144.353876:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616969088 00000100:00100000:2.0:1789518144.353885:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616969088 00000100:00100000:2.0:1789518144.353940:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00100000:2.0:1789518144.353949:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4003100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+58:10413:x1876445616969088:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789518144.354096:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4003100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+58:10413:x1876445616969088:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 147us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518144.354103:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00100000:0.0:1789518144.356943:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518144.357026:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616969216 00000100:00100000:1.0:1789518144.357057:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616969216 00000100:00100000:1.0:1789518144.357134:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:1.0:1789518144.357146:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+58:10413:x1876445616969216:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518144.357177:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518144.357205:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c7811e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc7f3 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.357312:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c7811f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.357330:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c7811f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.357345:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c7811f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518144.357391:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518144.357416:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c7811f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.357450:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c7811e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7f3 expref: 60 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.357470:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c7811f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7f3 expref: 59 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.357479:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99ffd8781500) 00010000:00010000:1.0:1789518144.357482:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789518144.357487:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f6800, rc 0) 00000100:00100000:1.0:1789518144.357562:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+59:10413:x1876445616969216:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 417us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518144.357576:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:1.0:1789518144.362203:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518144.362304:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616969344 00000100:00100000:0.0:1789518144.362321:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616969344 00000100:00100000:0.0:1789518144.362454:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:0.0:1789518144.362468:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4000700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2343:x1876445616969344:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518144.362493:0:6648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518144.362519:0:6648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a53e1245/0x631fd8698c7811f7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc7fa expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518144.362568:0:6648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa9e140, blocks: 0x1 00010000:00010000:0.0:1789518144.362599:0:6648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=198s v=(0 0) 00010000:00010000:0.0:1789518144.362605:0:6648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518144.362648:0:6648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a53e1245/0x631fd8698c7811f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7fa expref: 6 pid: 6648 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.362674:0:6648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a53e1245/0x631fd8698c7811f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7fa expref: 6 pid: 6648 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.362690:0:6648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd600, rc 0) 00000100:00100000:0.0:1789518144.362776:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4000700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2343:x1876445616969344:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 311us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518144.362784:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:3.0:1789518144.366503:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518144.367446:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616969600 00000100:00100000:0.0:1789518144.367457:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616969600 00000100:00100000:0.0:1789518144.367505:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:0.0:1789518144.367512:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+59:10413:x1876445616969600:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789518144.367952:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+59:10413:x1876445616969600:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 438us (1457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518144.367977:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:1.0:1789518144.372254:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518144.372375:0:8784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616969728 00000100:00100000:3.0:1789518144.372388:0:8784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616969728 00000100:00100000:3.0:1789518144.372497:0:8784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:3.0:1789518144.372508:0:8784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4001c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:10413:x1876445616969728:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518144.372528:0:8784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518144.372551:0:8784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c7811fe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc801 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.372589:0:8784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a53e1245/0x631fd8698c7811f7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7fa expref: 7 pid: 6648 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.372600:0:8784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518144.372605:0:8784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518144.372648:0:8784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c7811fe lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc801 expref: 7 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.372695:0:8784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a53e1245/0x631fd8698c7811f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7fa expref: 7 pid: 6648 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.372717:0:8784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a53e1245/0x631fd8698c7811f7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7fa expref: 7 pid: 6648 timeout: 298 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518144.372750:0:8784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc5568a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8784:1876445627469056:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518144.372855:0:8784:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6aed3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518144.386261:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518144.386409:0:8784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc5568a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8784:1876445627469056:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518144.386444:0:8784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c7811fe lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc801 expref: 7 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518144.386463:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616969856 00010000:00010000:3.0:1789518144.386466:0:8784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17200, rc 0) 00000100:00100000:0.0:1789518144.386479:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616969856 00010000:00010000:0.0:1789518144.386536:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a53e1245/0x631fd8698c7811f7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7fa expref: 8 pid: 6648 timeout: 298 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518144.386550:0:8784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4001c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+8:10413:x1876445616969728:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 14032us (14300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518144.386567:0:8784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:0.0:1789518144.386642:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:0.0:1789518144.386657:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd8064c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:2342:x1876445616969856:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518144.386677:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518144.386704:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a53e1245/0x631fd8698c7811f7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7fa expref: 7 pid: 6648 timeout: 298 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.386721:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a53e1245/0x631fd8698c7811f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7fa expref: 7 pid: 6648 timeout: 298 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.386750:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a53e1245/0x631fd8698c7811f7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7fa expref: 7 pid: 6648 timeout: 298 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.386767:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518144.386772:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518144.386782:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c7811fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc801 expref: 6 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.386795:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c7811fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc801 expref: 6 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.386845:0:5799:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c7811fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc801 expref: 6 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518144.386863:0:5799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7883100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5799:1876445627469184:192.168.206.51@tcp:105: 00000100:00100000:0.0:1789518144.386959:0:5799:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc514ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789518144.390735:0:5799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7883100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5799:1876445627469184:192.168.206.51@tcp:105: 00010000:00010000:3.0:1789518144.390777:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518144.390916:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd8064c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2342:x1876445616969856:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 4262us (4664us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518144.390929:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:2.0:1789518144.393369:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518144.393443:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616969984 00000100:00100000:3.0:1789518144.393452:0:6655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616969984 00002000:00100000:3.0:1789518144.393500:0:6655:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff99ffeda6aa00 x1876445616969984/t0(0) o4->cfa1c47d-1425-4fe5-be2a-28ad5152a12d@192.168.206.51@tcp:545/0 lens 504/0 e 0 to 0 dl 1789518155 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518144.393521:0:6655:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffeda6aa00 with x1876445616969984 ext(0->8) 00002000:00010000:3.0:1789518144.393526:0:6655:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffeda6aa00 00000100:00100000:3.0:1789518144.393569:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:3.0:1789518144.393579:0:6655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2342:x1876445616969984:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789518144.394275:0:6655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+8:2342:x1876445616969984:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 695us (915us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789518144.394288:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00002000:00100000:3.0:1789518144.394296:0:6655:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff99ffeda6aa00 x1876445616969984/t4294967302(0) o4->cfa1c47d-1425-4fe5-be2a-28ad5152a12d@192.168.206.51@tcp:545/0 lens 504/448 e 0 to 0 dl 1789518155 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518144.394305:0:6655:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffeda6aa00 with x1876445616969984 ext(0->8) 00002000:00010000:3.0:1789518144.394309:0:6655:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffeda6aa00 00000100:00100000:0.0:1789518144.400168:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518144.400283:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616970112 00000100:00100000:1.0:1789518144.400296:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616970112 00000100:00100000:1.0:1789518144.400403:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 79 00000100:00100000:1.0:1789518144.400417:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+59:10413:x1876445616970112:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789518144.437783:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000001:00080000:3.0:1789518144.437822:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:3.0:1789518144.437828:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:3.0:1789518144.437851:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:3.0:1789518144.437894:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1789518144.437914:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1789518144.437923:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99ffffbb50c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1789518144.437928:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff7a9b000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99ffffbb5900 00000020:00080000:3.0:1789518144.437931:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff7a9be00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99ffc776a000 00000020:00080000:3.0:1789518144.437990:0:5844:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1789518144.438099:0:5844:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1789518144.438253:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627469312:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789518144.438369:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518144.438491:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789518144.438499:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627469440:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789518144.438535:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518144.440772:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+13:10413:x1876445616970112:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 Request processed in 40349us (40610us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518144.440785:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 79 00000100:00100000:1.0:1789518144.443594:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627469440 00000100:00100000:1.0:1789518144.443604:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627469440 00000100:00100000:1.0:1789518144.443669:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789518144.443677:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4000e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627469440:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789518144.443702:0:6648:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1789518144.443734:0:6648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa9e13f, atime: 0x6aa9e13f, ctime: 0x6aa9e13f, blocks: 0x1 00010000:00010000:1.0:1789518144.443742:0:6648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a5a3310/0x631fd8698c781205 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.443757:0:6648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=198s v=(0 0) 00010000:00010000:1.0:1789518144.443761:0:6648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518144.443767:0:6648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a5a3310/0x631fd8698c781205 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.443795:0:6648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a5a3310/0x631fd8698c781205 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.443805:0:6648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a5a3310/0x631fd8698c781205 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.443813:0:6648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a5a3310/0x631fd8698c781205 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.443830:0:6648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789518144.444360:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4000e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3282:x1876445627469440:12345-0@lo:6:osp-syn-0-0.0 Request processed in 681us (5821us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789518144.444370:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:1.0:1789518144.444401:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518144.444407:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a5a3310/0x631fd8698c781205 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.444416:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518144.444421:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a5a3310/0x631fd8698c781205 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.444430:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a5a3310/0x631fd8698c781205 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.444447:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a5a3310/0x631fd8698c781205 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.444460:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a5a3310/0x631fd8698c781205 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.444480:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518144.444482:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518144.444554:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789518144.444596:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99ffeda6bb80/2, rc 0, transno 4294967301 00000100:00100000:1.0:1789518144.444603:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627469440:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789518144.445878:0:6647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627469312 00000100:00100000:2.0:1789518144.445887:0:6647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627469312 00000100:00100000:2.0:1789518144.445996:0:6647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789518144.446005:0:6647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4003b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627469312:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1789518144.446117:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1789518144.446162:0:6647:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789518144.446166:0:6647:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789518145 00002000:00010000:2.0:1789518144.446169:0:6647:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789518144.446171:0:6647:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789518144 -> 1789518145 00002000:00010000:2.0:1789518144.446173:0:6647:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789518144.446239:0:6647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4003b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627469312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 235us (7871us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789518144.446246:0:6647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:0.0:1789518144.446330:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fff7880700/2, rc 0, transno 4294967303 00000100:00100000:0.0:1789518144.446337:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627469312:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789518144.450889:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518144.450993:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616970240 00000100:00100000:1.0:1789518144.451003:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616970240 00000100:00100000:1.0:1789518144.451060:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:1.0:1789518144.451069:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+8:2343:x1876445616970240:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1789518144.501775:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1789518144.501793:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:2.0:1789518144.502033:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2343:x1876445616970240:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 Request processed in 50959us (51146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518144.502044:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:0.0:1789518144.508159:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518144.510133:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616970496 00000100:00100000:1.0:1789518144.510145:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616970496 00000100:00100000:1.0:1789518144.510198:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:1.0:1789518144.510207:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+13:10413:x1876445616970496:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789518144.510271:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518144.510296:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c7811f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7f3 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.510314:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99ffd8781500) 00010000:00010000:1.0:1789518144.510319:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518144.510346:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c78120c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.510376:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c78120c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.510499:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c78120c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789518144.511233:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b7eabae reply state 000000003b9a537c transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c78120c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518144.512145:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789518144.512271:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+14:10413:x1876445616970496:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 2061us (4117us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1789518144.512279:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 80 00010000:00010000:1.0:1789518144.514358:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c78120c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.514374:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c78120c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.514382:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c78120c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.514524:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518144.514529:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c78120c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.514537:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c78120c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.514556:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99ffd8781500) 00010000:00010000:1.0:1789518144.514574:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518144.514579:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c78120c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.514585:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c78120c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518144.518141:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518144.519024:0:8784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616970624 00000100:00100000:1.0:1789518144.519034:0:8784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616970624 00000100:00100000:1.0:1789518144.519086:0:8784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:1.0:1789518144.519095:0:8784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2342:x1876445616970624:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789518144.519340:0:8784:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1789518144.519344:0:8784:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789518145 -> 1789518144 00002000:00010000:1.0:1789518144.519347:0:8784:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789518143 00002000:00010000:1.0:1789518144.519350:0:8784:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789518145 -> 1789518144 00002000:00010000:1.0:1789518144.519352:0:8784:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789518144.519425:0:8784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:2342:x1876445616970624:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 330us (1291us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789518144.519434:0:8784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:0.0:1789518144.521720:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518144.521871:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616970880 00000100:00100000:1.0:1789518144.521880:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616970880 00000100:00100000:1.0:1789518144.521936:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:1.0:1789518144.521946:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+13:10413:x1876445616970880:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789518144.522882:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781213 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.522902:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7811cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7e5 expref: 13 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.522930:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781213 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.522978:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7811cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7e5 expref: 13 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.522993:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7811cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7e5 expref: 13 pid: 8051 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518144.524362:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4001f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1876445627469568:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518144.524943:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbb5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518144.527856:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4001f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1876445627469568:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518144.527900:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781213 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518144.528551:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518144.528670:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616971008 00000100:00100000:1.0:1789518144.528686:0:5798:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616971008 00010000:00010000:1.0:1789518144.528732:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7811cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7e5 expref: 14 pid: 8051 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518144.529090:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 43 00000100:00100000:0.0:1789518144.529107:0:5798:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed745c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+14:2342:x1876445616971008:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518144.529129:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518144.529139:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7811cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7e5 expref: 14 pid: 8051 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.529155:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7811cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7e5 expref: 14 pid: 8051 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.529191:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7811cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7e5 expref: 14 pid: 8051 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.529211:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99ffd8781500) 00010000:00010000:0.0:1789518144.529216:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781213 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.529227:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781213 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.529236:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781213 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.529276:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518144.529340:0:5798:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed745c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+13:2342:x1876445616971008:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 239us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518144.529348:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 43 00010000:00010000:1.0:1789518144.529412:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781213 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.529421:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781213 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.529455:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781213 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.529463:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781213 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.529471:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781213 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.529484:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f6800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518144.529490:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781213 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.529499:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781213 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.529509:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99ffd8781500) 00010000:00010000:1.0:1789518144.529523:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789518144.529528:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781213 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.529534:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781213 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518144.529585:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+12:10413:x1876445616970880:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 Request processed in 7641us (7874us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789518144.529593:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:3.0:1789518144.531878:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518144.531999:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616971136 00000100:00100000:2.0:1789518144.532079:0:6649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616971136 00000100:00100000:2.0:1789518144.532147:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:2.0:1789518144.532160:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5568a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:2345:x1876445616971136:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789518144.532199:0:6649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c78121a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518144.532218:0:6649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c7811fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc801 expref: 7 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518144.532226:0:6649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518144.532231:0:6649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518144.532236:0:6649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c78121a lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518144.532485:0:6649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c7811fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc801 expref: 7 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518144.532499:0:6649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c7811fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc801 expref: 7 pid: 8784 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518144.532512:0:6649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff664700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6649:1876445627469696:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518144.532598:0:6649:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc2af16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518144.534105:0:6649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff664700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6649:1876445627469696:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518144.534130:0:6649:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c78121a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518144.535851:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518144.536173:0:7597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616971264 00000100:00100000:1.0:1789518144.536185:0:7597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616971264 00010000:00010000:1.0:1789518144.536236:0:7597:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c7811fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc801 expref: 8 pid: 8784 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518144.536288:0:7597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:1.0:1789518144.536298:0:7597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc556b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+8:2343:x1876445616971264:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518144.536315:0:7597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518144.536341:0:7597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c7811fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc801 expref: 8 pid: 8784 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.536379:0:7597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c7811fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc801 expref: 8 pid: 8784 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.536408:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c7811fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc801 expref: 8 pid: 8784 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.536429:0:7597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518144.536434:0:7597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518144.536440:0:7597:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c78121a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.536451:0:7597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c78121a lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.536485:0:7597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518144.536563:0:7597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc556b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:2343:x1876445616971264:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 265us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518144.536570:0:7597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 44 00010000:00010000:2.0:1789518144.538122:0:6649:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c78121a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518144.538141:0:6649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c78121a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518144.538178:0:6649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c78121a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518144.538187:0:6649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c78121a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518144.538546:0:6649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c78121a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518144.538565:0:6649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518144.538569:0:6649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c78121a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518144.538579:0:6649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c78121a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518144.538598:0:6649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c78121a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518144.538606:0:6649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c78121a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518144.538757:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5568a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2345:x1876445616971136:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 Request processed in 6596us (6886us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518144.538767:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:3.0:1789518144.540880:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518144.541150:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616971520 00000100:00100000:0.0:1789518144.541163:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616971520 00000100:00100000:0.0:1789518144.541269:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 82 00000100:00100000:0.0:1789518144.541291:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+12:10413:x1876445616971520:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789518144.541395:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c781221 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.541417:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c781221 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.541431:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c781221 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.541776:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781228 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.541796:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7811db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7ec expref: 13 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.541805:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781228 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.541846:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7811db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7ec expref: 13 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.541861:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7811db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7ec expref: 13 pid: 8051 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518144.541999:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed747b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1876445627469824:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518144.542158:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc514aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789518144.545294:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518144.545716:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616971648 00000100:00100000:2.0:1789518144.545728:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616971648 00000100:00100000:0.0:1789518144.546454:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed747b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1876445627469824:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518144.546487:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781228 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.548928:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7811db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7ec expref: 14 pid: 8051 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518144.548982:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 45 00000100:00100000:1.0:1789518144.548997:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc556aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+14:2342:x1876445616971648:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518144.549012:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518144.549018:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7811db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7ec expref: 14 pid: 8051 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.549044:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7811db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7ec expref: 14 pid: 8051 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.549066:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7811db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7ec expref: 14 pid: 8051 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.549081:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99ffd8781500) 00010000:00010000:1.0:1789518144.549086:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781228 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.549095:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781228 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.549102:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781228 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518144.549146:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518144.549213:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc556aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+13:2342:x1876445616971648:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 221us (3930us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518144.549221:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 45 00010000:00010000:3.0:1789518144.551434:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781228 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.551455:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781228 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789518144.551739:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1789518144.551911:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1789518144.551972:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1789518144.552103:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc5569c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5812:1876445627469952:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789518144.552185:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518144.552224:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6aed780 going to sleep for 11 seconds 00000100:00100000:2.0:1789518144.552507:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627469952 00000100:00100000:2.0:1789518144.552521:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627469952 00000100:00100000:2.0:1789518144.552581:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789518144.552591:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5812:x1876445627469952:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789518144.552817:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5812:x1876445627469952:12345-0@lo:1000:mdt00_001.0 Request processed in 225us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518144.552851:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789518144.552945:0:5812:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1789518144.552953:0:5812:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fff7880700, transno 4294967303 00000100:00100000:0.0:1789518144.552985:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc5569c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5812:1876445627469952:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1789518144.553512:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1789518144.553588:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed747b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5812:1876445627470080:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789518144.554160:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518144.554201:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc514a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518144.554331:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627470080 00000100:00100000:2.0:1789518144.554338:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627470080 00000100:00100000:3.0:1789518144.554430:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789518144.554446:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5812:x1876445627470080:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789518144.554771:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5812:x1876445627470080:12345-0@lo:1000:mdt00_001.0 Request processed in 330us (614us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789518144.554779:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789518144.555884:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed747b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5812:1876445627470080:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1789518144.555938:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781228 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.555952:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781228 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.555973:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781228 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.555981:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bde00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518144.555987:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781228 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.555996:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781228 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.556015:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99ffd8781500) 00010000:00010000:0.0:1789518144.556019:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518144.556024:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781228 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.556031:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781228 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.556078:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c781156 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.556086:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c781156 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.556108:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c781156 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.556114:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518144.556117:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c781156 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.556123:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c781156 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.556131:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffc2fdc800) 00010000:00010000:0.0:1789518144.556134:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518144.556137:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c781156 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.556143:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c781156 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.556167:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78122f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.556185:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781172 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7d0 expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.556195:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78122f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.556236:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781172 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7d0 expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.556265:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781172 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7d0 expref: 16 pid: 5813 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518144.556280:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed746680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1876445627470208:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518144.556374:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc514a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518144.560369:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed746680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1876445627470208:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518144.560406:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78122f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518144.561429:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518144.561698:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616971776 00000100:00100000:3.0:1789518144.561710:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616971776 00010000:00010000:3.0:1789518144.561757:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781172 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7d0 expref: 17 pid: 5813 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518144.561803:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 46 00000100:00100000:3.0:1789518144.561813:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4001880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+17:2343:x1876445616971776:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518144.561831:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518144.561839:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781172 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7d0 expref: 17 pid: 5813 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.561853:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781172 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7d0 expref: 17 pid: 5813 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.561910:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781172 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc7d0 expref: 17 pid: 5813 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.561929:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffc2fdc800) 00010000:00010000:3.0:1789518144.561936:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78122f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.561946:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78122f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.561955:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78122f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.562003:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518144.562076:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4001880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+16:2343:x1876445616971776:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 264us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518144.562084:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 46 00010000:00010000:0.0:1789518144.562267:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78122f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.562277:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78122f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.562292:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78122f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.562300:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78122f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.562307:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78122f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.562314:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518144.562319:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78122f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.562327:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78122f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.562346:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffc2fdc800) 00010000:00010000:0.0:1789518144.562348:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518144.562354:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78122f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.562360:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78122f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.562372:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c781221 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.562379:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c781221 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.562386:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c781221 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.562397:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518144.562400:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c781221 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.562406:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c781221 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.562414:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffc2fdc800) 00010000:00010000:0.0:1789518144.562416:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789518144.562419:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c781221 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.562425:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c781221 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518144.563123:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+15:10413:x1876445616971520:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 21830us (22253us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1789518144.563132:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 82 00000020:00080000:0.0:1789518144.563138:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789518144.563674:0:11633:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789518144.563683:0:11633:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518144.563715:0:11633:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789518144.563722:0:11633:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789518144.565177:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518144.565279:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616972032 00000100:00100000:3.0:1789518144.565291:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616972032 00000100:00100000:3.0:1789518144.565418:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:3.0:1789518144.565430:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+15:10413:x1876445616972032:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789518144.566417:0:5815:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789518144.566528:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1789518144.566578:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c781236 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.566596:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c781236 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.566657:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c781236 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.566668:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c781236 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.566676:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c781236 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.566684:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c781236 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518144.566711:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789518144.566833:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+17:10413:x1876445616972032:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 1402us (1663us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1789518144.566841:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 20 00000020:00080000:3.0:1789518144.566848:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789518144.567009:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518144.567017:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c781236 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.567027:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17c00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518144.567032:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c781236 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.567043:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c781236 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.567058:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99ffd8781600) 00010000:00010000:0.0:1789518144.567061:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789518144.567068:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c781236 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.567075:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c781236 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518144.567094:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518144.567096:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518144.567098:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518144.946830:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789518145.806856:0:12003:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789518145.806865:0:12003:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518145.806903:0:12003:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789518145.806909:0:12003:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789518145.951500:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518145.951680:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616972288 00000100:00100000:3.0:1789518145.951689:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616972288 00000100:00100000:3.0:1789518145.951741:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 83 00000100:00100000:3.0:1789518145.951750:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+17:10432:x1876445616972288:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518145.951772:0:8051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518145.951790:0:8051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c78123d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc808 expref: -99 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.951898:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c781244 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.951912:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c781244 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.951925:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c781244 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518145.951937:0:8051:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789518145.952064:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c78123d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc808 expref: 20 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.952079:0:8051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c781244 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc808 expref: 19 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.952088:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ffd8781a00) 00010000:00010000:3.0:1789518145.952091:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789518145.952094:0:8051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16000, rc 0) 00000100:00100000:3.0:1789518145.952149:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+19:10432:x1876445616972288:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 399us (657us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1789518145.952156:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 83 00000100:00100000:3.0:1789518145.962925:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518145.962967:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616972416 00000100:00100000:3.0:1789518145.962976:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616972416 00000100:00100000:3.0:1789518145.963024:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 84 00000100:00100000:3.0:1789518145.963034:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+19:10432:x1876445616972416:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:3.0:1789518145.963108:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781252 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.963125:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781252 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.963137:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781252 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.963150:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781259 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.963158:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.963164:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.963371:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c781260 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.963380:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c781260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.963387:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c781260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518145.963422:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c781260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.963434:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781252 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.963449:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781252 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.963456:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781252 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.963462:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518145.963467:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781252 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.963475:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781252 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.963487:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ffd8781a00) 00010000:00010000:3.0:1789518145.963489:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518145.963494:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781252 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.963500:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781252 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.963768:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.963776:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781259 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.963783:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781259 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.963788:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518145.963797:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781259 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.963804:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781259 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.963812:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99ffd8781800) 00010000:00010000:3.0:1789518145.963815:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518145.963818:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781259 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.963824:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781259 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.963837:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c781260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.963843:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c781260 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.963850:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c781260 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.963854:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518145.963857:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c781260 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.963863:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c781260 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.963869:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffd8781600) 00010000:00010000:3.0:1789518145.963871:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518145.963879:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c781260 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.963885:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c781260 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518145.963950:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+19:10432:x1876445616972416:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 916us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518145.963971:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 84 00010000:00010000:3.0:1789518145.975595:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518145.996154:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518145.996246:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616972672 00000100:00100000:3.0:1789518145.996255:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616972672 00000100:00100000:3.0:1789518145.996345:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 85 00000100:00100000:3.0:1789518145.996355:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4000000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+19:10435:x1876445616972672:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518145.996374:0:8051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518145.996392:0:8051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c781267 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc80f expref: -99 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.996469:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78126e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.996483:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78126e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.996493:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78126e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.996516:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781275 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.996524:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781275 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.996544:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781275 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.996804:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c78127c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.996813:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c78127c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.996820:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c78127c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518145.996829:0:8051:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789518145.996921:0:8051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78126e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.996928:0:8051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78126e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.996935:0:8051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78126e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.996941:0:8051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518145.996944:0:8051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78126e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.996963:0:8051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78126e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.996975:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ffd8781a00) 00010000:00010000:3.0:1789518145.996978:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518145.996988:0:8051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78126e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.996995:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78126e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.997006:0:8051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781275 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.997011:0:8051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781275 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.997017:0:8051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781275 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.997022:0:8051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518145.997025:0:8051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781275 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.997031:0:8051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781275 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.997038:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99ffd8781600) 00010000:00010000:3.0:1789518145.997041:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518145.997044:0:8051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781275 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.997049:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781275 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.997085:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c781267 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc80f expref: 22 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.997109:0:8051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c78127c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc80f expref: 21 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518145.997116:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffd8781800) 00010000:00010000:3.0:1789518145.997119:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518145.997121:0:8051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17800, rc 0) 00000100:00100000:3.0:1789518145.997184:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4000000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+21:10435:x1876445616972672:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 830us (1037us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1789518145.997192:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 85 00000100:00100000:0.0:1789518146.001092:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518146.001225:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616972800 00000100:00100000:2.0:1789518146.001234:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616972800 00000100:00100000:2.0:1789518146.003311:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 86 00000100:00100000:2.0:1789518146.003331:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+21:10435:x1876445616972800:12345-192.168.206.51@tcp:54:lfs.0 00010000:00010000:2.0:1789518146.003459:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c78128a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.003475:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c78128a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.003487:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c78128a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.003511:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c78128a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.003519:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c78128a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.003525:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c78128a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.003646:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518146.003652:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c78128a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.003675:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c78128a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.003688:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffd8781800) 00010000:00010000:2.0:1789518146.003691:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789518146.003696:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c78128a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.003703:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c78128a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518146.003781:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+21:10435:x1876445616972800:12345-192.168.206.51@tcp:54:lfs.0 Request processed in 458us (2697us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518146.003790:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 86 00000100:00080000:0.0:1789518146.003795:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518146.008182:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518146.009927:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616973056 00000100:00100000:1.0:1789518146.009939:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616973056 00000100:00100000:1.0:1789518146.010049:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:1.0:1789518146.010060:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfa72050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+21:10435:x1876445616973056:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1789518146.010286:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfa72050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+22:10435:x1876445616973056:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 226us (2110us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1789518146.010305:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:1.0:1789518146.029462:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518146.029559:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616973312 00000100:00100000:2.0:1789518146.029568:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616973312 00000100:00100000:2.0:1789518146.029661:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 87 00000100:00100000:2.0:1789518146.029674:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4002a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+22:9957:x1876445616973312:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1789518146.029700:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518146.029721:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781291 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc816 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.029809:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c781298 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.029824:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c78127c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc80f expref: 23 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.029832:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c781298 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.029874:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c78127c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc80f expref: 23 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.029886:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c78127c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc80f expref: 23 pid: 8051 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518146.029898:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff665c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1876445627470336:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518146.030025:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc2af16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518146.032556:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff665c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1876445627470336:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518146.032567:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:1.0:1789518146.032591:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c781298 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518146.032736:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616973440 00000100:00100000:3.0:1789518146.032790:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616973440 00010000:00010000:3.0:1789518146.032841:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c78127c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc80f expref: 24 pid: 8051 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518146.032905:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:3.0:1789518146.033125:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed747800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+24:2343:x1876445616973440:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518146.033211:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518146.033221:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c78127c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc80f expref: 24 pid: 8051 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.033290:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c78127c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc80f expref: 24 pid: 8051 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.033319:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c78127c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc80f expref: 24 pid: 8051 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.033359:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffd8781800) 00010000:00010000:3.0:1789518146.033366:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c781298 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.033376:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c781298 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.033386:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c781298 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.033841:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518146.033919:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed747800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+23:2343:x1876445616973440:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 797us (1365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518146.033928:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 47 00010000:00010000:1.0:1789518146.034571:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c781298 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.034868:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c781298 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518146.034891:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1789518146.035049:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781291 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc816 expref: 24 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.035068:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c781298 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc816 expref: 23 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.035076:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffd8781800) 00010000:00010000:1.0:1789518146.035078:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789518146.035082:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696a00, rc 0) 00000100:00100000:1.0:1789518146.035149:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4002a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+23:9957:x1876445616973312:12345-192.168.206.51@tcp:101:bash.0 Request processed in 5478us (5694us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1789518146.035158:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 87 00000100:00100000:0.0:1789518146.039352:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518146.039859:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616973696 00000100:00100000:2.0:1789518146.039872:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616973696 00000100:00100000:2.0:1789518146.039986:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 88 00000100:00100000:2.0:1789518146.039998:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+23:9957:x1876445616973696:12345-192.168.206.51@tcp:36:bash.0 00010000:00010000:2.0:1789518146.040339:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c7812a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.040360:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c7812a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.040373:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c7812a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789518146.040432:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1789518146.040459:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dbb01dc2 reply state 00000000de19b237 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c7812a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518146.040468:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789518146.044197:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1789518146.046346:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+27:9957:x1876445616973696:12345-192.168.206.51@tcp:36:bash.0 Request processed in 6336us (6994us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1789518146.046379:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 88 00000020:00080000:2.0:1789518146.046390:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789518146.048205:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518146.048369:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616973824 00000100:00100000:3.0:1789518146.048382:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616973824 00000100:00100000:3.0:1789518146.048504:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 89 00000100:00100000:3.0:1789518146.048516:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+27:9957:x1876445616973824:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:3.0:1789518146.048544:0:8051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518146.048571:0:8051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7812ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc81d expref: -99 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.048608:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c7812a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.048677:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c7812a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.048685:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c7812a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.048812:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7812ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc81d expref: 28 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.054904:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518146.054920:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c7812a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.054923:0:8051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7812ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc81d expref: 28 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.054971:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c7812a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.054991:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffd8781800) 00010000:00010000:1.0:1789518146.054996:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518146.055001:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c7812a6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.055008:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c7812a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.055042:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffd8781800) 00010000:00010000:3.0:1789518146.055048:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518146.055052:0:8051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17800, rc 0) 00000100:00100000:3.0:1789518146.055208:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+27:9957:x1876445616973824:12345-192.168.206.51@tcp:101:bash.0 Request processed in 6692us (7010us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518146.055219:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 89 00000100:00100000:0.0:1789518146.058427:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518146.058654:0:8784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616973952 00000100:00100000:1.0:1789518146.058816:0:8784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616973952 00000100:00100000:1.0:1789518146.058943:0:8784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:1.0:1789518146.058999:0:8784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed744700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:9957:x1876445616973952:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:1.0:1789518146.059022:0:8784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518146.059051:0:8784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce6b5ba9/0x631fd8698c7812b4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc824 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789518146.059085:0:8784:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa9e140, atime: 0x6aa9e13f, ctime: 0x6aa9e140, blocks: 0xb 00010000:00010000:1.0:1789518146.059132:0:8784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=200s v=(0 0) 00010000:00010000:1.0:1789518146.059138:0:8784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518146.059148:0:8784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce6b5ba9/0x631fd8698c7812b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc824 expref: 7 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.059171:0:8784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ce6b5ba9/0x631fd8698c7812b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc824 expref: 7 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.059186:0:8784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f7800, rc 0) 00000100:00100000:1.0:1789518146.059275:0:8784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed744700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:9957:x1876445616973952:12345-192.168.206.51@tcp:101:bash.0 Request processed in 315us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518146.059282:0:8784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00080000:0.0:1789518146.061008:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518146.065848:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518146.065921:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616974080 00000100:00100000:0.0:1789518146.065933:0:6653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616974080 00002000:00010000:0.0:1789518146.065996:0:6653:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1789518146.066001:0:6653:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffff665c00 with x1876445616974080 ext(0->18446744073709551615) 00002000:00010000:0.0:1789518146.066015:0:6653:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffff665c00. 00000100:00100000:0.0:1789518146.066047:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:0.0:1789518146.066057:0:6653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:2342:x1876445616974080:12345-192.168.206.51@tcp:10:bash.0 00002000:00010000:0.0:1789518146.066379:0:6653:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789518146.066383:0:6653:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789518144 -> 1789518146 00002000:00010000:0.0:1789518146.066386:0:6653:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1789518143 -> 1789518143 00002000:00010000:0.0:1789518146.066388:0:6653:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789518144 -> 1789518146 00002000:00010000:0.0:1789518146.066391:0:6653:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1789518146.066535:0:6653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+8:2342:x1876445616974080:12345-192.168.206.51@tcp:10:bash.0 Request processed in 478us (926us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789518146.066543:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1 00002000:00010000:0.0:1789518146.066547:0:6653:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1789518146.066550:0:6653:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffff665c00 with x1876445616974080 ext(0->18446744073709551615) 00002000:00010000:0.0:1789518146.066555:0:6653:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffff665c00. 00000100:00100000:3.0:1789518146.112294:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518146.112893:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616974208 00000100:00100000:1.0:1789518146.112909:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616974208 00000100:00100000:1.0:1789518146.113000:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 90 00000100:00100000:1.0:1789518146.113013:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+27:10449:x1876445616974208:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:1.0:1789518146.113105:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c7812bb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.113126:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c7812bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.113140:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c7812bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.113158:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c7812c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.113165:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c7812c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.113192:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c7812c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.113494:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c7812c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.113504:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c7812c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.113512:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c7812c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789518146.113562:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c7812c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.113576:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c7812bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.113584:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c7812bb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.113591:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c7812bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.113598:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518146.113604:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c7812bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.113665:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c7812bb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.113681:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ffd8781a00) 00010000:00010000:1.0:1789518146.113691:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518146.113698:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c7812bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.113705:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c7812bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.113721:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c7812c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.113727:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c7812c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.113733:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c7812c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.113739:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f6800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518146.113742:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c7812c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.113749:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c7812c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.113757:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99ffc2fdce00) 00010000:00010000:1.0:1789518146.113760:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518146.113762:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c7812c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.113768:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c7812c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.113783:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c7812c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.113795:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c7812c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.113802:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c7812c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.113807:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518146.113810:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c7812c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.113817:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c7812c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.113824:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffd8781800) 00010000:00010000:1.0:1789518146.113827:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518146.113830:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c7812c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.113836:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c7812c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518146.113938:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+27:10449:x1876445616974208:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 926us (1650us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518146.113961:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 90 00000100:00100000:1.0:1789518146.140330:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518146.140933:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616974464 00000100:00100000:2.0:1789518146.140948:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616974464 00000100:00100000:2.0:1789518146.141063:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 91 00000100:00100000:2.0:1789518146.141074:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4002680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+27:10452:x1876445616974464:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518146.141096:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518146.141118:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c7812d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc82b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.141184:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c7812d7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.141197:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c7812d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.143275:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c7812d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.143308:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7812de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.143319:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7812de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.143327:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7812de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.143574:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c7812e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.143591:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c7812e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.143599:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c7812e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518146.143610:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789518146.144824:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c7812d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.144832:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c7812d7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.144839:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c7812d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.144845:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518146.144849:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c7812d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.144857:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c7812d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.144868:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ffd8781a00) 00010000:00010000:2.0:1789518146.144871:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518146.144876:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c7812d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.144881:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c7812d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.144892:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7812de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.144909:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7812de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.144915:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7812de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.144920:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518146.144923:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7812de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.144929:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7812de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.144935:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99ffc2ad3f00) 00010000:00010000:2.0:1789518146.144938:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518146.144940:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7812de lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.144945:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7812de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.145001:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c7812d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc82b expref: 30 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.145016:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c7812e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc82b expref: 29 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.145023:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffd8781800) 00010000:00010000:2.0:1789518146.145025:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789518146.145033:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697800, rc 0) 00000100:00100000:2.0:1789518146.145107:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4002680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+29:10452:x1876445616974464:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 4034us (4793us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1789518146.145116:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 91 00000100:00100000:2.0:1789518146.148999:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518146.152331:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616974592 00000100:00100000:3.0:1789518146.152345:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616974592 00000100:00100000:3.0:1789518146.152407:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 92 00000100:00100000:3.0:1789518146.152417:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+29:10452:x1876445616974592:12345-192.168.206.51@tcp:54:lfs.0 00010000:00010000:3.0:1789518146.152479:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7812f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.152494:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c781298 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc816 expref: 29 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.152514:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7812f3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.152547:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c781298 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc816 expref: 29 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.152560:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c781298 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc816 expref: 29 pid: 5811 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518146.152573:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7880700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1876445627470464:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518146.152830:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec1b57a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789518146.156798:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518146.156866:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7880700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1876445627470464:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518146.156901:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7812f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518146.156938:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616974848 00000100:00100000:1.0:1789518146.156950:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616974848 00000100:00100000:1.0:1789518146.157026:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:1.0:1789518146.157038:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+30:5577:x1876445616974848:12345-192.168.206.51@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789518146.157675:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+31:5577:x1876445616974848:12345-192.168.206.51@tcp:35:ldlm_bl.0 Request processed in 637us (886us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1789518146.157684:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:2.0:1789518146.160029:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518146.160109:0:7597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616974976 00000100:00100000:1.0:1789518146.160123:0:7597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616974976 00010000:00010000:1.0:1789518146.160165:0:7597:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c781298 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc816 expref: 31 pid: 5811 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518146.160204:0:7597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:1.0:1789518146.160212:0:7597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4979c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+31:2343:x1876445616974976:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518146.160228:0:7597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518146.160236:0:7597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c781298 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc816 expref: 31 pid: 5811 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.160250:0:7597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c781298 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc816 expref: 31 pid: 5811 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.160287:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c781298 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc816 expref: 31 pid: 5811 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.160307:0:7597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffd8781800) 00010000:00010000:1.0:1789518146.160314:0:7597:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7812f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.160325:0:7597:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7812f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.160333:0:7597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7812f3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.160386:0:7597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518146.160454:0:7597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4979c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+30:2343:x1876445616974976:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 240us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518146.160462:0:7597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 48 00010000:00010000:0.0:1789518146.160608:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7812f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518146.160660:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7812f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518146.160696:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7812f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518146.160870:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7812f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518146.160879:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7812f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518146.160886:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518146.160891:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7812f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518146.160900:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7812f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518146.160911:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffd8781800) 00010000:00010000:0.0:1789518146.160914:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789518146.160918:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7812f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518146.160925:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7812f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518146.161094:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+29:10452:x1876445616974592:12345-192.168.206.51@tcp:54:lfs.0 Request processed in 8676us (12109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518146.161103:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 92 00000100:00100000:2.0:1789518146.163226:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518146.163438:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616975232 00000100:00100000:1.0:1789518146.163449:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616975232 00000100:00100000:1.0:1789518146.163548:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:1.0:1789518146.163560:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+29:10452:x1876445616975232:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1789518146.163871:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+30:10452:x1876445616975232:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 312us (654us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1789518146.163878:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:0.0:1789518146.212250:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518146.212434:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616975488 00000100:00100000:3.0:1789518146.212448:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616975488 00000100:00100000:3.0:1789518146.212529:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 93 00000100:00100000:3.0:1789518146.212541:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+30:10463:x1876445616975488:12345-192.168.206.51@tcp:101:cat.0 00010000:00010000:3.0:1789518146.212576:0:8051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518146.212604:0:8051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7812fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc832 expref: -99 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.212758:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781301 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.212775:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781301 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.212789:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781301 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.212808:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c781308 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.212815:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c781308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.212822:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c781308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.213193:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c78130f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.213213:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c78130f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.213221:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c78130f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518146.213233:0:8051:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1789518146.213348:0:8051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781301 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.213357:0:8051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781301 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.213365:0:8051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781301 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.213371:0:8051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518146.213377:0:8051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781301 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.213386:0:8051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781301 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.213400:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ffd8781a00) 00010000:00010000:3.0:1789518146.213404:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518146.213410:0:8051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781301 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.213417:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781301 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.213431:0:8051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c781308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.213445:0:8051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c781308 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.213451:0:8051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c781308 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.213457:0:8051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518146.213460:0:8051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c781308 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.213467:0:8051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c781308 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.213475:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99ffd8781600) 00010000:00010000:3.0:1789518146.213478:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518146.213481:0:8051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c781308 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.213487:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c781308 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.213540:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7812fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc832 expref: 33 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.213555:0:8051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c78130f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc832 expref: 32 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.213563:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffd8781800) 00010000:00010000:3.0:1789518146.213565:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518146.213574:0:8051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17a00, rc 0) 00000100:00100000:3.0:1789518146.213715:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+32:10463:x1876445616975488:12345-192.168.206.51@tcp:101:cat.0 Request processed in 1173us (1477us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1789518146.213725:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 93 00000100:00100000:3.0:1789518146.218404:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518146.219164:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616975744 00000100:00100000:2.0:1789518146.219179:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616975744 00000100:00100000:2.0:1789518146.219317:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:2.0:1789518146.219329:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+32:10463:x1876445616975744:12345-192.168.206.51@tcp:35:cat.0 00000100:00100000:2.0:1789518146.219677:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+33:10463:x1876445616975744:12345-192.168.206.51@tcp:35:cat.0 Request processed in 348us (1284us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1789518146.219686:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:0.0:1789518146.239787:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518146.239904:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616976000 00000100:00100000:1.0:1789518146.239917:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616976000 00000100:00100000:1.0:1789518146.240045:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 94 00000100:00100000:1.0:1789518146.240058:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+33:10464:x1876445616976000:12345-192.168.206.51@tcp:36:rm.0 00010000:00010000:1.0:1789518146.240131:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789518146.240165:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c78130f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc832 expref: 33 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.240189:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c7812e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc82b expref: 32 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.240222:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7812ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc81d expref: 31 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.240233:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffd8781800) 00010000:00010000:1.0:1789518146.240246:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518146.240271:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c78131d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.240287:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c78131d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.240310:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c78131d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.240327:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781324 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.240334:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781324 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.240340:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781324 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.240670:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c78132b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.240680:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c78132b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.240687:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c78132b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789518146.241308:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:1.0:1789518146.241325:0:5813:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 200237710223ns, next at 201237707366ns, rc = 0 00010000:00010000:1.0:1789518146.241394:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c781332 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.241404:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c781332 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.241411:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c781332 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.241419:0:5813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c781332 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.241425:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c781332 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.241431:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c781332 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.241460:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518146.241484:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c78132b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.241490:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c78132b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.241498:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c78132b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.241504:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518146.241516:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c78132b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.241526:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c78132b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.241537:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffc2fdcb00) 00010000:00010000:1.0:1789518146.241540:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789518146.241545:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c78132b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.241552:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c78132b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.241572:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c78131d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.241578:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c78131d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.241584:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c78131d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.241589:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518146.241592:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c78131d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.241599:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c78131d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.241607:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ffd8781a00) 00010000:00010000:1.0:1789518146.241610:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518146.241642:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c78131d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.241648:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c78131d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789518146.241660:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cbe6d916 reply state 0000000039c8428c transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781324 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518146.241670:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789518146.241771:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+32:10464:x1876445616976000:12345-192.168.206.51@tcp:36:rm.0 Request processed in 1714us (1996us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1789518146.241781:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 94 00010000:00010000:2.0:1789518146.241916:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518146.241924:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c781332 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.241931:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f6000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518146.241935:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c781332 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.241941:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c781332 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.241961:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99ffc2fdcb00) 00010000:00010000:2.0:1789518146.241963:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789518146.241966:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c781332 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.241983:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c781332 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.241998:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518146.242000:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518146.242002:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518146.244340:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781324 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.244362:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781324 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.244371:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781324 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.244377:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f6800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518146.244382:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781324 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.244390:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781324 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.244409:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99ffc2fdce00) 00010000:00010000:1.0:1789518146.244412:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518146.244417:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781324 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.244441:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781324 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518146.273341:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518146.273713:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616976256 00000100:00100000:3.0:1789518146.273726:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616976256 00000100:00100000:3.0:1789518146.273791:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 95 00000100:00100000:3.0:1789518146.273803:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+31:10470:x1876445616976256:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:3.0:1789518146.273838:0:8051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518146.273862:0:8051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781339 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc839 expref: -99 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.274087:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c781340 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.274107:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c781340 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.274121:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c781340 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.274139:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781347 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.274146:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781347 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.274153:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781347 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789518146.275089:0:8051:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1789518146.275305:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c78134e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.275320:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c78134e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.275330:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c78134e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.275370:0:8051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c781340 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.275379:0:8051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c781340 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.275388:0:8051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c781340 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.275394:0:8051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518146.275399:0:8051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c781340 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.275408:0:8051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c781340 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.275422:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ffd8781a00) 00010000:00010000:3.0:1789518146.275426:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518146.275431:0:8051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c781340 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.275452:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c781340 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518146.275468:0:8051:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000576aa116 reply state 000000000958699c transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781347 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518146.275479:0:8051:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789518146.275591:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781339 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc839 expref: 34 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.275605:0:8051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c78134e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc839 expref: 33 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.275610:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffd8781500) 00010000:00010000:3.0:1789518146.275640:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518146.275643:0:8051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17400, rc 0) 00000100:00100000:3.0:1789518146.275784:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+34:10470:x1876445616976256:12345-192.168.206.51@tcp:101:bash.0 Request processed in 1982us (2456us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1789518146.275792:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 95 00010000:00010000:1.0:1789518146.277602:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781347 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.277715:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781347 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.277723:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781347 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.277730:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518146.277734:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781347 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.277743:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781347 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.277760:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99ffd8781600) 00010000:00010000:1.0:1789518146.277763:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518146.277768:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781347 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.277774:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781347 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518146.279107:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518146.279157:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616976384 00000100:00100000:1.0:1789518146.279170:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616976384 00000100:00100000:1.0:1789518146.279273:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00080000:0.0:1789518146.279282:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518146.279285:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:2342:x1876445616976384:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:1.0:1789518146.279324:0:6648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518146.279350:0:6648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a245654c/0x631fd8698c78135c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc840 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789518146.279394:0:6648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518146.279419:0:6648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=200s v=(0 0) 00010000:00010000:1.0:1789518146.279424:0:6648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518146.279435:0:6648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a245654c/0x631fd8698c78135c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc840 expref: 8 pid: 6648 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.279456:0:6648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a245654c/0x631fd8698c78135c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc840 expref: 8 pid: 6648 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.279472:0:6648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f6800, rc 0) 00000100:00100000:1.0:1789518146.279546:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+8:2342:x1876445616976384:12345-192.168.206.51@tcp:101:bash.0 Request processed in 263us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518146.279554:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:0.0:1789518146.282585:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518146.282772:0:8784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616976512 00000100:00100000:1.0:1789518146.282783:0:8784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616976512 00000100:00100000:1.0:1789518146.282900:0:8784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:1.0:1789518146.282920:0:8784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+8:10470:x1876445616976512:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:1.0:1789518146.282944:0:8784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518146.282980:0:8784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003919af53/0x631fd8698c781363 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc847 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.283018:0:8784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a245654c/0x631fd8698c78135c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc840 expref: 9 pid: 6648 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.283047:0:8784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518146.283052:0:8784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518146.283059:0:8784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003919af53/0x631fd8698c781363 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc847 expref: 9 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.283114:0:8784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a245654c/0x631fd8698c78135c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc840 expref: 9 pid: 6648 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.283130:0:8784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a245654c/0x631fd8698c78135c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc840 expref: 9 pid: 6648 timeout: 300 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518146.283146:0:8784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4001180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8784:1876445627470592:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518146.283253:0:8784:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbb5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789518146.285744:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518146.285910:0:8784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4001180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8784:1876445627470592:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518146.285965:0:8784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003919af53/0x631fd8698c781363 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc847 expref: 9 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.285991:0:8784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f7e00, rc 0) 00000100:00100000:1.0:1789518146.286053:0:8784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+9:10470:x1876445616976512:12345-192.168.206.51@tcp:101:bash.0 Request processed in 3135us (3481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518146.286063:0:8784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:3.0:1789518146.286422:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616976640 00000100:00100000:3.0:1789518146.286433:0:5798:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616976640 00010000:00010000:3.0:1789518146.286470:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a245654c/0x631fd8698c78135c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc840 expref: 9 pid: 6648 timeout: 300 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518146.286583:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:1.0:1789518146.286594:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd8064050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+9:2342:x1876445616976640:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518146.286757:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518146.286784:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a245654c/0x631fd8698c78135c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc840 expref: 9 pid: 6648 timeout: 300 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.286798:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a245654c/0x631fd8698c78135c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc840 expref: 9 pid: 6648 timeout: 300 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.286823:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a245654c/0x631fd8698c78135c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc840 expref: 9 pid: 6648 timeout: 300 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.286841:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518146.286845:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518146.286854:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003919af53/0x631fd8698c781363 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc847 expref: 8 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.286864:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003919af53/0x631fd8698c781363 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc847 expref: 8 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.286902:0:5797:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003919af53/0x631fd8698c781363 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc847 expref: 8 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518146.286917:0:5797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4001180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5797:1876445627470720:192.168.206.51@tcp:105: 00000100:00100000:1.0:1789518146.287043:0:5797:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbb5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789518146.288676:0:5797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4001180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5797:1876445627470720:192.168.206.51@tcp:105: 00010000:00010000:1.0:1789518146.288705:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518146.288769:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd8064050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+8:2342:x1876445616976640:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 2176us (3038us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518146.288780:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:0.0:1789518146.290128:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518146.290253:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616976896 00000100:00100000:1.0:1789518146.290263:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616976896 00000100:00100000:1.0:1789518146.290316:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:1.0:1789518146.290327:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+33:10470:x1876445616976896:12345-192.168.206.51@tcp:35:bash.0 00000100:00100000:1.0:1789518146.291907:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+34:10470:x1876445616976896:12345-192.168.206.51@tcp:35:bash.0 Request processed in 1573us (1780us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1789518146.291920:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:0.0:1789518146.383970:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518146.385193:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616977024 00000100:00100000:3.0:1789518146.385210:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616977024 00000100:00100000:3.0:1789518146.385294:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 96 00000100:00100000:3.0:1789518146.385306:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+34:10486:x1876445616977024:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518146.385358:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518146.385385:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c78136a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc84e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.385481:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c781371 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.385498:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c781371 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.385519:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c781371 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518146.385563:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789518146.385569:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518146.385590:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c781371 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.385636:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c78136a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc84e expref: 36 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.385657:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c781371 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc84e expref: 35 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.385666:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ffd8781a00) 00010000:00010000:3.0:1789518146.385669:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789518146.385674:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17200, rc 0) 00000100:00100000:3.0:1789518146.385752:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+35:10486:x1876445616977024:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 448us (2247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518146.385760:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 96 00000100:00100000:0.0:1789518146.389802:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518146.390207:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616977280 00000100:00100000:2.0:1789518146.390236:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616977280 00000100:00100000:2.0:1789518146.390348:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 97 00000100:00100000:2.0:1789518146.390385:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+35:10486:x1876445616977280:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518146.390414:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518146.390460:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c781378 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc855 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.391751:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78137f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.391776:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c78134e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc839 expref: 36 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.391788:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78137f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.391841:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c78134e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc839 expref: 36 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.391859:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c78134e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc839 expref: 36 pid: 8051 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518146.391902:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0792680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1876445627470848:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518146.392203:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc2af16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518146.395779:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0792680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1876445627470848:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518146.395825:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78137f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518146.400248:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518146.401271:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616977408 00000100:00100000:3.0:1789518146.401287:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616977408 00010000:00010000:3.0:1789518146.401349:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c78134e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc839 expref: 37 pid: 8051 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518146.401404:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00100000:3.0:1789518146.401416:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed746a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+37:2342:x1876445616977408:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518146.401435:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518146.401443:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c78134e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc839 expref: 37 pid: 8051 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.401460:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c78134e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc839 expref: 37 pid: 8051 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.401485:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c78134e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc839 expref: 37 pid: 8051 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.401506:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffd8781500) 00010000:00010000:3.0:1789518146.401526:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78137f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.401537:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78137f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.401546:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78137f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.401584:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518146.403107:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78137f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.403125:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78137f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518146.403154:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789518146.403378:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c781378 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc855 expref: 38 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.403585:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78137f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc855 expref: 37 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.403596:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffd8781500) 00010000:00010000:2.0:1789518146.403599:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789518146.403603:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696000, rc 0) 00000100:00100000:2.0:1789518146.403794:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+37:10486:x1876445616977280:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 13434us (14000us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1789518146.403804:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 97 00000100:00100000:3.0:1789518146.403907:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed746a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+36:2342:x1876445616977408:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 2491us (3671us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518146.403936:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00100000:0.0:1789518146.409208:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518146.409264:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616977664 00000100:00100000:1.0:1789518146.409289:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616977664 00000100:00100000:1.0:1789518146.409370:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 98 00000100:00100000:1.0:1789518146.409383:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+36:10486:x1876445616977664:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518146.409418:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518146.409422:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789518146.409457:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78137f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc855 expref: 36 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.409480:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffd8781500) 00010000:00010000:1.0:1789518146.409495:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518146.409526:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c78138d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc85c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.409714:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c781394 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.409733:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c781394 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.409767:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c781394 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518146.409782:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789518146.410689:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c78138d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc85c expref: 38 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.410711:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c781394 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc85c expref: 37 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.410720:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffc2fdc400) 00010000:00010000:1.0:1789518146.410724:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789518146.410727:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f6a00, rc 0) 00000100:00100000:1.0:1789518146.410821:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+37:10486:x1876445616977664:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1439us (1622us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1789518146.410831:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 98 00000100:00100000:1.0:1789518146.416219:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518146.416320:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616977792 00000100:00100000:3.0:1789518146.416334:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616977792 00000100:00100000:3.0:1789518146.416419:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 99 00000100:00100000:3.0:1789518146.416431:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4001880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+37:10486:x1876445616977792:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518146.416464:0:8051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518146.416491:0:8051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7813a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc863 expref: -99 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.417107:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7813a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc863 expref: 38 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.417125:0:8051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7813a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc863 expref: 38 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.417146:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffc2fdc400) 00010000:00010000:3.0:1789518146.417150:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518146.417154:0:8051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17400, rc 0) 00000100:00100000:3.0:1789518146.417277:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4001880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+38:10486:x1876445616977792:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 848us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518146.417286:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 99 00000100:00100000:0.0:1789518146.421149:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518146.421238:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616977920 00000100:00100000:1.0:1789518146.421252:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616977920 00000100:00100000:1.0:1789518146.421325:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:1.0:1789518146.421337:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+8:2343:x1876445616977920:12345-192.168.206.51@tcp:1:lfs.0 00010000:00010000:1.0:1789518146.421395:0:6648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a5a3310/0x631fd8698c7813a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.421422:0:6648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003919af53/0x631fd8698c781363 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc847 expref: 8 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.421456:0:6648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518146.421461:0:6648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518146.421467:0:6648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a5a3310/0x631fd8698c7813a9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.421522:0:6648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003919af53/0x631fd8698c781363 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc847 expref: 8 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.421538:0:6648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003919af53/0x631fd8698c781363 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc847 expref: 8 pid: 8784 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518146.421555:0:6648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4001180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6648:1876445627470976:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518146.421711:0:6648:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbb56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518146.426229:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518146.426401:0:6648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4001180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6648:1876445627470976:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518146.426437:0:6648:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003a5a3310/0x631fd8698c7813a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518146.426767:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616978048 00000100:00100000:3.0:1789518146.426778:0:6655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616978048 00002000:00100000:3.0:1789518146.426843:0:6655:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff99ffed746680 x1876445616978048/t0(0) o4->cfa1c47d-1425-4fe5-be2a-28ad5152a12d@192.168.206.51@tcp:547/0 lens 504/0 e 0 to 0 dl 1789518157 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518146.426855:0:6655:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed746680 with x1876445616978048 ext(0->8) 00010000:00010000:3.0:1789518146.426893:0:6655:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003919af53/0x631fd8698c781363 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc847 expref: 9 pid: 8784 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.426910:0:6655:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003919af53/0x631fd8698c781363 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc847 expref: 9 pid: 8784 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789518146.426918:0:6655:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99ffed746680 00000100:00100000:3.0:1789518146.426968:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:3.0:1789518146.426979:0:6655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+9:2343:x1876445616978048:12345-192.168.206.51@tcp:4:lfs.0 00000100:00100000:2.0:1789518146.433125:0:6655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+11:2343:x1876445616978048:12345-192.168.206.51@tcp:4:lfs.0 Request processed in 6123us (6887us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789518146.433167:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1 00002000:00100000:2.0:1789518146.433250:0:6655:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff99ffed746680 x1876445616978048/t4294967302(0) o4->cfa1c47d-1425-4fe5-be2a-28ad5152a12d@192.168.206.51@tcp:547/0 lens 504/448 e 0 to 0 dl 1789518157 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518146.433263:0:6655:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed746680 with x1876445616978048 ext(0->8) 00010000:00010000:2.0:1789518146.433276:0:6655:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003919af53/0x631fd8698c781363 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc847 expref: 11 pid: 8784 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.433311:0:6655:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003919af53/0x631fd8698c781363 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc847 expref: 11 pid: 8784 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518146.433321:0:6655:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99ffed746680 00000100:00100000:3.0:1789518146.436970:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518146.437064:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616978176 00000100:00100000:0.0:1789518146.437078:0:5798:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616978176 00010000:00010000:0.0:1789518146.437142:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003919af53/0x631fd8698c781363 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc847 expref: 11 pid: 8784 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518146.437312:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 51 00000100:00100000:0.0:1789518146.437327:0:5798:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+11:2343:x1876445616978176:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518146.437346:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789518146.437372:0:5798:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789518146.437375:0:5798:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789518146 00002000:00010000:0.0:1789518146.437378:0:5798:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789518147 00002000:00010000:0.0:1789518146.437380:0:5798:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789518146 00010000:00010000:0.0:1789518146.437387:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003919af53/0x631fd8698c781363 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc847 expref: 11 pid: 8784 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518146.437421:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003919af53/0x631fd8698c781363 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc847 expref: 11 pid: 8784 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518146.437828:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003919af53/0x631fd8698c781363 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc847 expref: 11 pid: 8784 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518146.437852:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518146.437858:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518146.437865:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003a5a3310/0x631fd8698c7813a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518146.437964:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a5a3310/0x631fd8698c7813a9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518146.438014:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518146.438026:0:6648:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003a5a3310/0x631fd8698c7813a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.438041:0:6648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a5a3310/0x631fd8698c7813a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.438078:0:6648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a5a3310/0x631fd8698c7813a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.438097:0:6648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a5a3310/0x631fd8698c7813a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518146.438099:0:5798:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+10:2343:x1876445616978176:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 773us (1149us total) trans 0 rc 0/0 00010000:00010000:1.0:1789518146.438110:0:6648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a5a3310/0x631fd8698c7813a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.438119:0:6648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518146.438124:0:6648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a5a3310/0x631fd8698c7813a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.438135:0:6648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a5a3310/0x631fd8698c7813a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.438150:0:6648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a5a3310/0x631fd8698c7813a9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.438157:0:6648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a5a3310/0x631fd8698c7813a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518146.438181:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 51 00000100:00100000:1.0:1789518146.438216:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+10:2343:x1876445616977920:12345-192.168.206.51@tcp:1:lfs.0 Request processed in 16881us (17081us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518146.438224:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:2.0:1789518146.441070:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518146.441163:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616978432 00000100:00100000:1.0:1789518146.441174:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616978432 00000100:00100000:1.0:1789518146.441241:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:1.0:1789518146.441266:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfa71c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+38:10486:x1876445616978432:12345-192.168.206.51@tcp:35:lfs.0 00000004:00010000:1.0:1789518146.441353:0:5814:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c781394 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc85c expref: 38 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789518146.442897:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1789518146.442977:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1789518146.443357:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1789518146.443420:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c7813b0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.443443:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7813a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc863 expref: 42 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.443454:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c7813b0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.443515:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7813a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc863 expref: 42 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.443534:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7813a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc863 expref: 42 pid: 8051 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518146.443552:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4001180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5814:1876445627471104:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518146.444027:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbb56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518146.446444:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518146.446962:0:7597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616978560 00000100:00100000:3.0:1789518146.446974:0:7597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616978560 00010000:00010000:3.0:1789518146.447034:0:7597:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7813a2 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc863 expref: 43 pid: 8051 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518146.447087:0:7597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 52 00000100:00100000:3.0:1789518146.447098:0:7597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0792680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+43:2342:x1876445616978560:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518146.447117:0:7597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518146.447126:0:7597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7813a2 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc863 expref: 43 pid: 8051 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.447142:0:7597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7813a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc863 expref: 43 pid: 8051 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.447169:0:7597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffc2fdc400) 00010000:00010000:3.0:1789518146.447176:0:7597:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c7813b0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.447205:0:7597:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c7813b0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.447215:0:7597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c7813b0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.447241:0:7597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518146.447316:0:7597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0792680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+43:2342:x1876445616978560:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 220us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518146.447325:0:7597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 52 00010000:00010000:1.0:1789518146.449284:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7813a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc863 expref: 42 pid: 8051 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518146.449311:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4001180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5814:1876445627471104:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518146.449359:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c7813b0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.449371:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c7813b0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.449376:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c7813b0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789518146.449773:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1789518146.450450:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1789518146.450741:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4001180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5814:1876445627471232:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789518146.450808:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518146.450842:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbb5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789518146.451003:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627471232 00000100:00100000:3.0:1789518146.451011:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627471232 00000100:00100000:3.0:1789518146.451101:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789518146.451111:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4001f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5814:x1876445627471232:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789518146.451211:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4001f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5814:x1876445627471232:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 101us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518146.451219:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789518146.451269:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518146.451304:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4001180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5814:1876445627471232:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789518146.452113:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1789518146.452193:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4001180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5814:1876445627471360:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789518146.452238:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518146.452458:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbb56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518146.452497:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627471360 00000100:00100000:3.0:1789518146.452565:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627471360 00000100:00100000:2.0:1789518146.452649:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789518146.452662:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5814:x1876445627471360:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789518146.452783:0:5816:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1789518146.452791:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1789518146.452874:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5814:x1876445627471360:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 215us (634us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789518146.452882:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789518146.452982:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4001180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5814:1876445627471360:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789518146.453037:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1789518146.453076:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c7813b0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.453086:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c7813b0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.453092:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c7813b0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.453113:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f6200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518146.453119:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c7813b0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.453128:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c7813b0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.453150:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffc2fdc400) 00010000:00010000:1.0:1789518146.453153:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789518146.453160:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c7813b0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.453167:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c7813b0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789518146.453356:0:5814:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789518146.453488:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1789518146.453501:0:5814:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 200449886969ns, next at 201449884107ns, rc = 0 00000001:00080000:1.0:1789518146.453521:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1789518146.453553:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffc2fdc400) 00010000:00010000:1.0:1789518146.453556:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789518146.453564:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c781394 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc85c expref: 46 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518146.453720:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfa71c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+45:10486:x1876445616978432:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 12454us (12662us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1789518146.453729:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 26 00000020:00080000:1.0:1789518146.453734:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789518146.456886:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518146.457017:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616978688 00000100:00100000:3.0:1789518146.457029:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616978688 00000100:00100000:1.0:1789518146.457171:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 100 00000100:00100000:1.0:1789518146.457185:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+45:10486:x1876445616978688:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518146.457215:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518146.457243:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c7813b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc86a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.457399:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c7813b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc86a expref: 46 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.457419:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c7813b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc86a expref: 46 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.457445:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:1.0:1789518146.457448:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789518146.457452:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f7600, rc 0) 00000100:00100000:1.0:1789518146.457532:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+46:10486:x1876445616978688:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 351us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518146.457541:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 100 00000100:00100000:3.0:1789518146.462126:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518146.465858:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616978944 00000100:00100000:1.0:1789518146.465879:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616978944 00000100:00100000:1.0:1789518146.466014:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:1.0:1789518146.466032:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+46:10486:x1876445616978944:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1789518146.466391:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+47:10486:x1876445616978944:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 364us (4278us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1789518146.466399:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:2.0:1789518146.526049:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518146.526843:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616979072 00000100:00100000:1.0:1789518146.526857:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616979072 00000100:00100000:1.0:1789518146.527012:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 101 00000100:00100000:1.0:1789518146.527025:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+47:10496:x1876445616979072:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:1.0:1789518146.527126:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c7813be lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.527149:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c7813be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.527164:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c7813be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.527183:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c7813c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.527191:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c7813c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.527199:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c7813c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.527309:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c7813cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.527318:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c7813cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.527325:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c7813cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789518146.527377:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c7813cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.527391:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c7813be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.527408:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c7813be lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.527416:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c7813be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.527423:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f6a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518146.527428:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c7813be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.527436:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c7813be lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.527450:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ffd8781a00) 00010000:00010000:1.0:1789518146.527453:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518146.527459:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c7813be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.527465:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c7813be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.527480:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c7813c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.527486:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c7813c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.527491:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c7813c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.527496:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f6200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518146.527504:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c7813c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.527510:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c7813c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.527517:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99ffc2fdc400) 00010000:00010000:1.0:1789518146.527520:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518146.527523:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c7813c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.527530:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c7813c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.527546:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c7813cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.527552:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c7813cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.527558:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c7813cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.527562:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f6400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518146.527565:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c7813cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.527570:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c7813cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.527576:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:1.0:1789518146.527579:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518146.527588:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c7813cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.527594:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c7813cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518146.527739:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+47:10496:x1876445616979072:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 716us (1704us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518146.527747:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 101 00000100:00100000:0.0:1789518146.560117:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518146.560241:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616979328 00000100:00100000:3.0:1789518146.560254:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616979328 00000100:00100000:3.0:1789518146.560336:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 102 00000100:00100000:3.0:1789518146.560348:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+47:10499:x1876445616979328:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518146.560397:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518146.560424:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7813d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc871 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.560536:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7813da lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.560554:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7813da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.560567:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7813da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.560581:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7813e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.560588:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7813e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.560594:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7813e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.560774:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7813e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.560784:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7813e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.560791:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7813e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518146.560807:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789518146.560938:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7813da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.560947:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7813da lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.560965:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7813da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.560972:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518146.560978:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7813da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.560987:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7813da lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.561002:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ffd8781a00) 00010000:00010000:3.0:1789518146.561006:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518146.561011:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7813da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.561018:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7813da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.561034:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7813e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.561040:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7813e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.561047:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7813e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.561052:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518146.561061:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7813e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.561068:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7813e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.561076:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99ffd8781b00) 00010000:00010000:3.0:1789518146.561078:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518146.561081:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7813e1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.561087:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7813e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.561135:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7813d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc871 expref: 50 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.561152:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7813e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc871 expref: 49 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.561160:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:3.0:1789518146.561162:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518146.561165:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17400, rc 0) 00000100:00100000:3.0:1789518146.561298:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+49:10499:x1876445616979328:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 950us (1196us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1789518146.561312:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 102 00000100:00100000:2.0:1789518146.565811:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518146.566370:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616979456 00000100:00100000:3.0:1789518146.566383:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616979456 00000100:00100000:3.0:1789518146.566466:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 103 00000100:00100000:3.0:1789518146.566478:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+49:10499:x1876445616979456:12345-192.168.206.51@tcp:54:lfs.0 00010000:00010000:3.0:1789518146.566594:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7813f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.566650:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7813f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.566667:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7813f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.566711:0:8051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7813f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.566720:0:8051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7813f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.566729:0:8051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7813f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.566737:0:8051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518146.566743:0:8051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7813f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.566752:0:8051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7813f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.566769:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:3.0:1789518146.566773:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789518146.566780:0:8051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7813f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.566787:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7813f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518146.566911:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+49:10499:x1876445616979456:12345-192.168.206.51@tcp:54:lfs.0 Request processed in 435us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518146.566921:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 103 00000100:00100000:2.0:1789518146.569331:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518146.569511:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616979712 00000100:00100000:1.0:1789518146.569523:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616979712 00000100:00100000:1.0:1789518146.569597:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:1.0:1789518146.569610:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+49:10499:x1876445616979712:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1789518146.569958:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+50:10499:x1876445616979712:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 341us (629us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1789518146.569967:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:0.0:1789518146.614127:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518146.614351:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616979968 00000100:00100000:1.0:1789518146.614364:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616979968 00000100:00100000:1.0:1789518146.614481:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 104 00000100:00100000:1.0:1789518146.614494:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+50:10509:x1876445616979968:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:1.0:1789518146.614535:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518146.614539:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789518146.614573:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c781371 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc84e expref: 50 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.614595:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ffd8781a00) 00010000:00010000:1.0:1789518146.614601:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518146.614809:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c7813fd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc878 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.615010:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c781404 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.615033:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7813e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc871 expref: 50 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.615045:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c781404 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.615087:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7813e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc871 expref: 50 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.615103:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7813e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc871 expref: 50 pid: 5812 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518146.615119:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc556b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1876445627471488:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518146.615566:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab3000 going to sleep for 11 seconds 00000100:00100000:1.0:1789518146.617778:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc556b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1876445627471488:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518146.617813:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c781404 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518146.617910:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518146.618000:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616980096 00000100:00100000:1.0:1789518146.618019:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616980096 00010000:00010000:1.0:1789518146.618060:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7813e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc871 expref: 51 pid: 5812 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518146.618094:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 53 00000100:00100000:1.0:1789518146.618120:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+51:2343:x1876445616980096:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518146.618137:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518146.618145:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7813e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc871 expref: 51 pid: 5812 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.618159:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7813e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc871 expref: 51 pid: 5812 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.618184:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7813e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc871 expref: 51 pid: 5812 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.618202:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:1.0:1789518146.618208:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c781404 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.618219:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c781404 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.618228:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c781404 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.618257:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518146.618397:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+50:2343:x1876445616980096:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 278us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518146.618407:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 53 00010000:00010000:3.0:1789518146.618592:0:5813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c781404 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.618607:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c781404 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518146.618718:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789518146.618896:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c7813fd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc878 expref: 51 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.618910:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c781404 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc878 expref: 50 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.618916:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:3.0:1789518146.618918:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789518146.618920:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f6200, rc 0) 00000100:00100000:3.0:1789518146.618972:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+50:10509:x1876445616979968:12345-192.168.206.51@tcp:101:bash.0 Request processed in 4481us (4858us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1789518146.618979:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 104 00000100:00100000:3.0:1789518146.622243:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518146.622415:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616980352 00000100:00100000:1.0:1789518146.622427:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616980352 00000100:00100000:1.0:1789518146.622493:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 105 00000100:00100000:1.0:1789518146.622504:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+50:10509:x1876445616980352:12345-192.168.206.51@tcp:36:bash.0 00010000:00010000:1.0:1789518146.622965:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c781412 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.622984:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c781412 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.622996:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c781412 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789518146.623057:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1789518146.623082:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000065265d4c reply state 000000004ac16cee transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c781412 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518146.623092:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789518146.623212:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+53:10509:x1876445616980352:12345-192.168.206.51@tcp:36:bash.0 Request processed in 697us (972us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1789518146.623221:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 105 00000020:00080000:1.0:1789518146.623228:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789518146.624692:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c781412 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.625013:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c781412 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.625023:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c781412 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.625030:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f6a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518146.625036:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c781412 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518146.625043:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:1.0:1789518146.625050:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c781412 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.625084:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:1.0:1789518146.625087:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518146.625093:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c781412 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.625101:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c781412 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518146.625223:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616980480 00000100:00100000:0.0:1789518146.625234:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616980480 00000100:00100000:0.0:1789518146.625289:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 106 00000100:00100000:0.0:1789518146.625303:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+52:10509:x1876445616980480:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:0.0:1789518146.625342:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518146.625361:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c781419 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc87f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518146.625450:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781420 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518146.625464:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c781404 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc878 expref: 53 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518146.625473:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781420 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518146.625530:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c781404 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc878 expref: 53 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518146.625546:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c781404 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc878 expref: 53 pid: 5813 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518146.625562:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffffdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1876445627471616:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518146.626134:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffdb52c600 going to sleep for 11 seconds 00000100:00100000:2.0:1789518146.628937:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518146.628992:0:7597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616980608 00000100:00100000:3.0:1789518146.629003:0:7597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616980608 00010000:00010000:3.0:1789518146.629048:0:7597:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c781404 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc878 expref: 54 pid: 5813 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518146.629096:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffffdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1876445627471616:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518146.629120:0:7597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 54 00000100:00100000:3.0:1789518146.629132:0:7597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+54:2342:x1876445616980608:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518146.629136:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781420 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.629150:0:7597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518146.629159:0:7597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c781404 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc878 expref: 54 pid: 5813 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.629173:0:7597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c781404 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc878 expref: 54 pid: 5813 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.629198:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c781404 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc878 expref: 54 pid: 5813 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.629226:0:7597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:3.0:1789518146.629232:0:7597:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781420 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.629242:0:7597:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.629250:0:7597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781420 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.629280:0:7597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518146.629329:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518146.629335:0:7597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+53:2342:x1876445616980608:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 204us (408us total) trans 0 rc 0/0 00010000:00010000:0.0:1789518146.629343:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518146.629404:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789518146.629410:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518146.629438:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518146.629482:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c781419 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc87f expref: 54 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518146.629499:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781420 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc87f expref: 53 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518146.629507:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:0.0:1789518146.629510:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518146.629514:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bde00, rc 0) 00000100:00100000:3.0:1789518146.629519:0:7597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 54 00000100:00100000:0.0:1789518146.629558:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+52:10509:x1876445616980480:12345-192.168.206.51@tcp:101:bash.0 Request processed in 4258us (4521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518146.629567:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 106 00000100:00100000:2.0:1789518146.632227:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518146.632354:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616980864 00000100:00100000:1.0:1789518146.632366:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616980864 00000100:00100000:1.0:1789518146.632432:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:1.0:1789518146.632443:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+52:10509:x1876445616980864:12345-192.168.206.51@tcp:35:bash.0 00000100:00100000:1.0:1789518146.632864:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+53:10509:x1876445616980864:12345-192.168.206.51@tcp:35:bash.0 Request processed in 422us (649us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1789518146.632873:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:2.0:1789518146.660584:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518146.660781:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616980992 00000100:00100000:3.0:1789518146.660814:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616980992 00000100:00100000:3.0:1789518146.660894:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 107 00000100:00100000:3.0:1789518146.660907:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+53:10515:x1876445616980992:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518146.660937:0:8051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518146.660976:0:8051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781427 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc886 expref: -99 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.661055:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c78142e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.661070:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c78142e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.661149:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c78142e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518146.661209:0:8051:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789518146.661214:0:8051:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518146.661235:0:8051:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c78142e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.661265:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781427 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc886 expref: 55 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.661288:0:8051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c78142e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc886 expref: 54 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.661297:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ffd8781a00) 00010000:00010000:3.0:1789518146.661300:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789518146.661305:0:8051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16800, rc 0) 00000100:00100000:3.0:1789518146.661385:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+54:10515:x1876445616980992:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 481us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518146.661393:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 107 00000100:00100000:2.0:1789518146.665354:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518146.665469:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616981120 00000100:00100000:3.0:1789518146.665481:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616981120 00000100:00100000:3.0:1789518146.665553:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 108 00000100:00100000:3.0:1789518146.665565:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+54:10515:x1876445616981120:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518146.665590:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518146.665650:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781435 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc88d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.665725:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c78143c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.665742:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c78143c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.665765:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c78143c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.665784:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781443 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.665791:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781443 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.665797:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781443 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.665899:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c78144a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.665924:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c78144a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.665931:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c78144a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518146.665981:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789518146.665986:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518146.666007:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c78144a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.666019:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c78144a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.666028:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c78143c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.666034:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c78143c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.666040:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c78143c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.666047:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518146.666051:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c78143c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.666059:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c78143c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.666072:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ffd8781a00) 00010000:00010000:3.0:1789518146.666075:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518146.666088:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c78143c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.666095:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c78143c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.666110:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781443 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.666117:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781443 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.666122:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781443 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.666128:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518146.666131:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781443 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.666137:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781443 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.666144:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99ffd8781b00) 00010000:00010000:3.0:1789518146.666146:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518146.666149:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781443 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.666154:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781443 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.666186:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781435 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc88d expref: 56 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.666212:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c78144a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc88d expref: 55 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.666219:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:3.0:1789518146.666222:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518146.666225:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17a00, rc 0) 00000100:00100000:3.0:1789518146.666299:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+55:10515:x1876445616981120:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 732us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518146.666307:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 108 00000100:00100000:2.0:1789518146.668424:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518146.668601:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518146.668778:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616981504 00000100:00100000:3.0:1789518146.668789:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616981504 00000100:00100000:3.0:1789518146.668853:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 109 00000100:00100000:3.0:1789518146.668864:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+55:10515:x1876445616981504:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518146.668885:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518146.668906:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c781451 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc894 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.669026:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781458 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.669042:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781420 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc87f expref: 56 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.669051:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c78144a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc88d expref: 56 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.669080:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781458 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.669120:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c78144a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc88d expref: 56 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.669135:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c78144a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc88d expref: 56 pid: 5813 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518146.669152:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1876445627471744:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518146.669216:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616981248 00000100:00100000:1.0:1789518146.669221:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616981248 00010000:00010000:1.0:1789518146.669249:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c78144a lrc: 6/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc88d expref: 57 pid: 5813 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518146.669276:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 55 00010000:00010000:3.0:1789518146.669286:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781420 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc87f expref: 57 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518146.669287:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6500e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+57:2343:x1876445616981248:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518146.669302:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518146.669304:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781420 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc87f expref: 57 pid: 5812 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.669312:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c78144a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc88d expref: 57 pid: 5813 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518146.669321:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1876445627471872:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518146.669330:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c78144a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc88d expref: 57 pid: 5813 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518146.669357:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec1b57300 going to sleep for 11 seconds 00010000:00010000:1.0:1789518146.669364:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:1.0:1789518146.669370:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781458 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.669377:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781458 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.669382:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518146.669409:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6500e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+57:2343:x1876445616981248:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 126us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518146.669417:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 55 00000100:00100000:3.0:1789518146.671993:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1876445627471872:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518146.673063:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:3.0:1789518146.673077:0:5811:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.51@tcp) returned -22 from blocking AST (req@00000000abe853c9 x1876445627471744) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c78144a lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc88d expref: 56 pid: 5813 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.673113:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c78144a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc88d expref: 56 pid: 5813 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518146.673168:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1876445627471744:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518146.673197:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:3.0:1789518146.673202:0:5811:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781458 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.673214:0:5811:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781458 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.673226:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781458 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518146.673242:0:7597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616981632 00000100:00100000:1.0:1789518146.673253:0:7597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616981632 00010000:00010000:1.0:1789518146.673297:0:7597:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781420 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc87f expref: 56 pid: 5812 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518146.673344:0:7597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 56 00000100:00100000:1.0:1789518146.673355:0:7597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd8064450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+56:2343:x1876445616981632:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518146.673373:0:7597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518146.673380:0:7597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781420 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc87f expref: 56 pid: 5812 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.673394:0:7597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781420 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc87f expref: 56 pid: 5812 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.673414:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781420 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc87f expref: 56 pid: 5812 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.673439:0:7597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:1.0:1789518146.673443:0:7597:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781458 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.673452:0:7597:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781458 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.673461:0:7597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781458 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.673494:0:7597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518146.673531:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781458 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.673541:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781458 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518146.673568:0:7597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd8064450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+55:2343:x1876445616981632:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 214us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518146.673577:0:7597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 56 00000004:00200000:3.0:1789518146.673700:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789518146.674176:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c781451 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc894 expref: 56 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.674197:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781458 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc894 expref: 55 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.674206:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:3.0:1789518146.674209:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789518146.674211:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17400, rc 0) 00000100:00100000:3.0:1789518146.674257:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+55:10515:x1876445616981504:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 5394us (5655us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1789518146.674280:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 109 00000100:00100000:2.0:1789518146.676166:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518146.676218:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616981888 00000100:00100000:1.0:1789518146.676227:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616981888 00000100:00100000:1.0:1789518146.676277:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:1.0:1789518146.676285:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6502300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+55:10515:x1876445616981888:12345-192.168.206.51@tcp:103:lfs.0 00010000:00010000:1.0:1789518146.676299:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518146.676323:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c7813b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc86a expref: 55 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518146.676343:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:1.0:1789518146.676347:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518146.676404:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6502300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+54:10515:x1876445616981888:12345-192.168.206.51@tcp:103:lfs.0 Request processed in 118us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518146.676411:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:2.0:1789518146.677790:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518146.677838:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616982016 00000100:00100000:3.0:1789518146.677846:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616982016 00000100:00100000:3.0:1789518146.677892:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 110 00000100:00100000:3.0:1789518146.677901:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+54:10515:x1876445616982016:12345-192.168.206.51@tcp:58:lfs.0 00010000:00010000:3.0:1789518146.678041:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781466 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.678064:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781466 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518146.678088:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781466 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789518146.678322:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1789518146.678419:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+54:10515:x1876445616982016:12345-192.168.206.51@tcp:58:lfs.0 Request processed in 519us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518146.678427:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 110 00000100:00100000:0.0:1789518146.680036:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518146.680146:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616982144 00000100:00100000:2.0:1789518146.680154:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616982144 00000100:00100000:2.0:1789518146.680267:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 111 00000100:00100000:2.0:1789518146.680278:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffffdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+54:10515:x1876445616982144:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518146.680332:0:8051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518146.680353:0:8051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c78146d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc89b expref: -99 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.680416:0:8051:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781466 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.680427:0:8051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c78146d lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc89b expref: 55 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.680449:0:8051:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781466 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.680523:0:8051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c78146d lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc89b expref: 55 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.680541:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:2.0:1789518146.680545:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518146.680661:0:8051:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c78146d lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc89b expref: 55 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518146.680672:0:8051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697a00, rc 0) 00000100:00100000:2.0:1789518146.680729:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffffdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+55:10515:x1876445616982144:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 454us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518146.680737:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 111 00010000:00010000:3.0:1789518146.995096:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518147.186944:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789518147.186979:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627472000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518147.187045:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518147.187870:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627472000 00000100:00100000:1.0:1789518147.187879:0:6651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627472000 00000100:00100000:1.0:1789518147.187956:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789518147.187970:0:6651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627472000:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789518147.187988:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1789518147.188007:0:6651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789518147.188071:0:6651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627472000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518147.188080:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789518147.188125:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627472256:0@lo:400:kworker.0 00000100:00100000:1.0:1789518147.188162:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518147.188177:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627472512:0@lo:400:kworker.0 00000100:00100000:1.0:1789518147.188203:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789518147.188206:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:824c8f07-28fa-48fd-81af-173b194570e6:3281:1876445627472128:0@lo:400:kworker.0 00000100:00100000:1.0:1789518147.188214:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627472384:0@lo:400:kworker.0 00000100:00100000:2.0:1789518147.188308:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627472256 00000100:00100000:2.0:1789518147.188313:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627472256 00000100:00100000:2.0:1789518147.188345:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789518147.188352:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc556b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627472256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518147.188494:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518147.188611:0:6647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627472512 00000100:00100000:0.0:1789518147.188648:0:6647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627472512 00000100:00100000:0.0:1789518147.188697:0:6647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789518147.188706:0:6647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffffffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3280:x1876445627472512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518147.188761:0:6647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffffffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3280:x1876445627472512:12345-0@lo:400:kworker.0 Request processed in 56us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518147.188787:0:6647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789518147.188832:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627472512:0@lo:400:kworker.0 00000100:00100000:3.0:1789518147.190660:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518147.190728:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627472640:0@lo:400:kworker.0 00000100:00100000:0.0:1789518147.190758:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627472128 00000100:00100000:0.0:1789518147.190770:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627472128 00000100:00100000:3.0:1789518147.190782:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518147.190836:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789518147.190846:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627472000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518147.190849:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7646c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+19:3281:x1876445627472128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518147.190907:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627472640 00000100:00100000:3.0:1789518147.190914:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627472640 00000100:00080000:3.0:1789518147.190958:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518147.190958:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7646c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+19:3281:x1876445627472128:12345-0@lo:400:kworker.0 Request processed in 99us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518147.190972:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789518147.190989:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:824c8f07-28fa-48fd-81af-173b194570e6:3281:1876445627472128:0@lo:400:kworker.0 00000100:00100000:3.0:1789518147.191055:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789518147.191063:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627472640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518147.191119:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627472640:12345-0@lo:400:kworker.0 Request processed in 57us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518147.191125:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789518147.191200:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627472640:0@lo:400:kworker.0 00000100:00100000:1.0:1789518147.192397:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518147.192479:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627472384 00000100:00100000:0.0:1789518147.192489:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627472384 00000100:00100000:0.0:1789518147.192582:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789518147.192591:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc556aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627472384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518147.192702:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc556aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627472384:12345-0@lo:400:kworker.0 Request processed in 109us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518147.192709:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789518147.192823:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627472384:0@lo:400:kworker.0 00000100:00100000:2.0:1789518147.194151:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc556b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627472256:12345-0@lo:400:kworker.0 Request processed in 5794us (5983us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518147.194164:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1789518147.194269:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518147.194289:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627472256:0@lo:400:kworker.0 00000040:00080000:2.0:1789518147.635072:0:11633:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789518147.635081:0:11633:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518147.635116:0:11633:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1789518147.635122:0:11633:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789518147.635246:0:11633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda7aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11633:1876445627472768:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789518147.635368:0:11633:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc2af1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789518147.642771:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518147.642890:0:11633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda7aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11633:1876445627472768:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789518147.643107:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616982272 00000100:00100000:3.0:1789518147.643116:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616982272 00000100:00100000:3.0:1789518147.643214:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 112 00000100:00100000:3.0:1789518147.643225:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+55:10516:x1876445616982272:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789518147.643257:0:8051:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789518147.643410:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+55:10516:x1876445616982272:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 186us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518147.643418:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 112 00000100:00100000:3.0:1789518147.647014:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518147.647989:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616982400 00000100:00100000:1.0:1789518147.647999:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616982400 00000100:00100000:1.0:1789518147.648049:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 113 00000100:00100000:1.0:1789518147.648058:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+55:10516:x1876445616982400:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789518147.648132:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c781474 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.648145:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c781474 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.648155:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c781474 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.648216:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c78147b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.648222:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c78147b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.648226:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c78147b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.648243:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c781482 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.648248:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c781482 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.648252:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c781482 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518147.648281:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789518147.648284:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518147.648293:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c781482 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.648300:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c781474 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.648304:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c781474 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.648309:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c781474 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.648319:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518147.648322:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c781474 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.648327:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c781474 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.648336:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffc2ad3d00) 00010000:00010000:1.0:1789518147.648338:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518147.648341:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c781474 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.648345:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c781474 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.648354:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c78147b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.648358:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c78147b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.648366:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c78147b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.648369:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518147.648371:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c78147b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.648374:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c78147b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.648383:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff99ffc2fdc400) 00010000:00010000:1.0:1789518147.648385:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518147.648386:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c78147b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.648390:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c78147b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.648399:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c781482 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.648403:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c781482 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.648406:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c781482 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.648409:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f6e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518147.648411:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c781482 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.648414:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c781482 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.648418:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:1.0:1789518147.648420:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518147.648422:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c781482 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.648427:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c781482 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518147.648515:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+55:10516:x1876445616982400:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 Request processed in 458us (1510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518147.648523:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 113 00000100:00100000:1.0:1789518147.652203:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518147.652405:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616982656 00000100:00100000:0.0:1789518147.652414:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616982656 00000100:00100000:0.0:1789518147.652509:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 114 00000100:00100000:0.0:1789518147.652519:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+55:10516:x1876445616982656:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518147.652537:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518147.652556:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c781489 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc8a2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.652691:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c781490 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.652706:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c781490 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.652718:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c781490 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518147.652728:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789518147.652819:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c781490 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.652827:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c781490 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.652833:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c781490 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.652839:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518147.652843:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c781490 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.652850:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c781490 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.652862:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:0.0:1789518147.652865:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789518147.652870:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c781490 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.652886:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c781490 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.652927:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c781489 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8a2 expref: 57 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.652938:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffc2ad3d00) 00010000:00010000:0.0:1789518147.652940:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789518147.652958:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c781489 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8a2 expref: 57 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.652969:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bca00, rc 0) 00000100:00100000:0.0:1789518147.653035:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+56:10516:x1876445616982656:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 518us (841us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1789518147.653043:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 114 00000100:00100000:0.0:1789518147.657104:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518147.657156:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616982784 00000100:00100000:2.0:1789518147.657166:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616982784 00000100:00100000:2.0:1789518147.657227:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 115 00000100:00100000:2.0:1789518147.657238:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffffe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+56:10516:x1876445616982784:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789518147.657276:0:5812:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789518147.657388:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffffe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+56:10516:x1876445616982784:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 152us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518147.657397:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 115 00000100:00100000:2.0:1789518147.660675:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518147.660763:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616983040 00000100:00100000:3.0:1789518147.660772:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616983040 00000100:00100000:3.0:1789518147.660814:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 116 00000100:00100000:3.0:1789518147.660823:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+56:10516:x1876445616983040:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518147.660852:0:8051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518147.660855:0:8051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789518147.660879:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c78142e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc886 expref: 56 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.660908:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ffd8781a00) 00010000:00010000:3.0:1789518147.660913:0:8051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518147.660925:0:8051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c78149e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc8a9 expref: -99 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789518147.661303:0:8051:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1789518147.661525:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7814a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.661600:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7814a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.661610:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7814a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.661684:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c78149e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8a9 expref: 58 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.661701:0:8051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7814a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8a9 expref: 57 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.661708:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99ffd8781b00) 00010000:00010000:3.0:1789518147.661711:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518147.661713:0:8051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17a00, rc 0) 00000100:00100000:3.0:1789518147.661766:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+57:10516:x1876445616983040:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 944us (1099us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1789518147.661774:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 116 00000100:00100000:3.0:1789518147.665274:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518147.665380:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616983296 00000100:00100000:2.0:1789518147.665391:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616983296 00000100:00100000:1.0:1789518147.665480:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 117 00000100:00100000:1.0:1789518147.665491:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+57:10516:x1876445616983296:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789518147.665554:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518147.665576:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7814a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8a9 expref: 57 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.665597:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99ffd8781b00) 00010000:00010000:1.0:1789518147.665607:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518147.665654:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c7814b3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.665671:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c7814b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.665680:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c7814b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.665738:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7814ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x5e45ae47 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.665966:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7814ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5e45ae47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.665974:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7814ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5e45ae47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.666042:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c7814b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.666049:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c7814b3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.666056:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c7814b3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.666062:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f6e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518147.666066:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c7814b3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.666073:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c7814b3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.666082:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ffd8781a00) 00010000:00010000:1.0:1789518147.666084:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518147.666089:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c7814b3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.666094:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c7814b3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.666103:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7814ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5e45ae47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.666109:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7814ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5e45ae47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.666114:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7814ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5e45ae47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.666124:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518147.666127:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7814ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5e45ae47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.666133:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7814ba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5e45ae47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.666140:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x5e45ae47 (ffff99ffc2fdc400) 00010000:00010000:1.0:1789518147.666142:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518147.666144:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7814ba lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5e45ae47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.666150:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7814ba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5e45ae47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518147.666264:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+56:10516:x1876445616983296:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 774us (996us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789518147.666271:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 117 00000100:00100000:0.0:1789518147.668719:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518147.668793:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616983424 00000100:00100000:3.0:1789518147.668800:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616983424 00000100:00100000:3.0:1789518147.668845:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 118 00000100:00100000:3.0:1789518147.668854:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+56:10516:x1876445616983424:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518147.668873:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518147.668897:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7814c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc8b0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.668929:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7814c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.668941:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7814c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.668967:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7814c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.669111:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7814c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8b0 expref: 58 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.669128:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7814c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8b0 expref: 57 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.669136:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99ffd8781400) 00010000:00010000:3.0:1789518147.669139:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789518147.669142:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16c00, rc 0) 00000100:00100000:3.0:1789518147.669193:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+57:10516:x1876445616983424:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 339us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518147.669208:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 118 00000100:00100000:2.0:1789518147.671492:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518147.671566:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616983680 00000100:00100000:0.0:1789518147.671576:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616983680 00000100:00100000:0.0:1789518147.671658:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 119 00000100:00100000:0.0:1789518147.671670:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+57:10516:x1876445616983680:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789518147.671741:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7814cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.671757:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7814cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.671784:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7814cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789518147.672043:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:0.0:1789518147.672065:0:5812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 201668451024ns, next at 202668448644ns, rc = 0 00000004:00010000:0.0:1789518147.672142:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000134534c4 reply state 00000000b2912f9a transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7814cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518147.672151:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518147.672236:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+59:10516:x1876445616983680:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 569us (751us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1789518147.672244:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 119 00010000:00010000:3.0:1789518147.674139:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7814cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.674152:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7814cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.674163:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7814cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.674169:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bca00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518147.674174:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7814cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.674182:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7814cf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.674194:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99ffd8781400) 00010000:00010000:3.0:1789518147.674197:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789518147.674202:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7814cf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.674217:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7814cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518147.674377:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518147.674428:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616983808 00000100:00100000:3.0:1789518147.674436:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616983808 00000100:00100000:3.0:1789518147.674527:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 120 00000100:00100000:3.0:1789518147.674537:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+58:10516:x1876445616983808:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518147.674557:0:8051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518147.674583:0:8051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7814d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc8b7 expref: -99 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.674671:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7814d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8b7 expref: 59 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.674684:0:8051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7814d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8b7 expref: 59 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.674701:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99ffd8781400) 00010000:00010000:3.0:1789518147.674704:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518147.674717:0:8051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17c00, rc 0) 00000100:00100000:3.0:1789518147.674756:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+59:10516:x1876445616983808:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 221us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518147.674764:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 120 00000100:00100000:1.0:1789518147.676845:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518147.678048:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616983936 00000100:00100000:2.0:1789518147.678058:0:6649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616983936 00000100:00100000:2.0:1789518147.678108:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00100000:2.0:1789518147.678120:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0792680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+8:2343:x1876445616983936:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789518147.679727:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0792680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+9:2343:x1876445616983936:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 1603us (2882us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789518147.679738:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00100000:2.0:1789518147.685218:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518147.685291:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616984192 00000100:00100000:3.0:1789518147.685301:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616984192 00000100:00100000:3.0:1789518147.685461:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:3.0:1789518147.685471:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+59:10516:x1876445616984192:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789518147.685704:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+60:10516:x1876445616984192:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 235us (494us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1789518147.685712:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:3.0:1789518147.688892:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518147.688985:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616984448 00000100:00100000:1.0:1789518147.688994:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616984448 00000100:00100000:1.0:1789518147.689053:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 121 00000100:00100000:1.0:1789518147.689063:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+60:10516:x1876445616984448:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789518147.689169:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+60:10516:x1876445616984448:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 106us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518147.689176:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 121 00000100:00100000:2.0:1789518147.691591:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518147.691653:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616984576 00000100:00100000:0.0:1789518147.691662:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616984576 00000100:00100000:0.0:1789518147.691720:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 122 00000100:00100000:0.0:1789518147.691730:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+60:10516:x1876445616984576:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518147.691751:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518147.691770:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c7814dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc8be expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.691851:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c7814e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.691865:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c7814e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.691880:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c7814e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518147.691928:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518147.691961:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c7814e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.691991:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c7814dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8be expref: 62 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.692008:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c7814e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8be expref: 61 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.692015:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99ffd8781400) 00010000:00010000:0.0:1789518147.692018:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789518147.692021:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bde00, rc 0) 00000100:00100000:0.0:1789518147.692088:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+61:10516:x1876445616984576:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 359us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518147.692096:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 122 00000100:00100000:2.0:1789518147.695565:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518147.695639:0:6647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616984704 00000100:00100000:0.0:1789518147.695649:0:6647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616984704 00000100:00100000:0.0:1789518147.695710:0:6647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:0.0:1789518147.695720:0:6647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+9:2342:x1876445616984704:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518147.695736:0:6647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518147.695755:0:6647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b635cb49/0x631fd8698c7814eb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc8c5 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518147.695780:0:6647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa9e144, blocks: 0x1 00010000:00010000:0.0:1789518147.695797:0:6647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=201s v=(0 0) 00010000:00010000:0.0:1789518147.695816:0:6647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518147.695824:0:6647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b635cb49/0x631fd8698c7814eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8c5 expref: 10 pid: 6647 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.696268:0:6647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b635cb49/0x631fd8698c7814eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8c5 expref: 10 pid: 6647 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.696283:0:6647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc400, rc 0) 00000100:00100000:0.0:1789518147.696336:0:6647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+10:2342:x1876445616984704:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 618us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518147.696343:0:6647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:3.0:1789518147.698193:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518147.698246:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616984960 00000100:00100000:0.0:1789518147.698253:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616984960 00000100:00100000:0.0:1789518147.698304:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 123 00000100:00100000:0.0:1789518147.698313:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffff28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+61:10516:x1876445616984960:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789518147.698393:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffff28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+61:10516:x1876445616984960:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 80us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518147.698401:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 123 00000100:00100000:0.0:1789518147.702293:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518147.702682:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616985088 00000100:00100000:3.0:1789518147.702690:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616985088 00000100:00100000:3.0:1789518147.702723:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 39 00000100:00100000:3.0:1789518147.702731:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffffff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+10:10516:x1876445616985088:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518147.702750:0:6648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518147.702765:0:6648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044e0d026/0x631fd8698c7814f2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc8cc expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.702797:0:6648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b635cb49/0x631fd8698c7814eb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8c5 expref: 11 pid: 6647 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.702804:0:6648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518147.702807:0:6648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518147.702811:0:6648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044e0d026/0x631fd8698c7814f2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8cc expref: 11 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.702836:0:6648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b635cb49/0x631fd8698c7814eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8c5 expref: 11 pid: 6647 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.702847:0:6648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b635cb49/0x631fd8698c7814eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8c5 expref: 11 pid: 6647 timeout: 301 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518147.702858:0:6648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffff29500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6648:1876445627472896:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518147.702935:0:6648:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec1b57780 going to sleep for 11 seconds 00000100:00100000:1.0:1789518147.705051:0:6648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffff29500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6648:1876445627472896:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518147.705106:0:6648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000044e0d026/0x631fd8698c7814f2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8cc expref: 11 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.705126:0:6648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16800, rc 0) 00000100:00100000:1.0:1789518147.705245:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffffff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+11:10516:x1876445616985088:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 2514us (2956us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518147.705254:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 39 00000100:00100000:2.0:1789518147.706689:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518147.707052:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616985216 00000100:00100000:1.0:1789518147.707061:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616985216 00010000:00010000:1.0:1789518147.707096:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b635cb49/0x631fd8698c7814eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8c5 expref: 11 pid: 6647 timeout: 301 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518147.707132:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00100000:1.0:1789518147.707144:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+11:2343:x1876445616985216:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518147.707158:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518147.707178:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b635cb49/0x631fd8698c7814eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8c5 expref: 11 pid: 6647 timeout: 301 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.707194:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b635cb49/0x631fd8698c7814eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8c5 expref: 11 pid: 6647 timeout: 301 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.707216:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b635cb49/0x631fd8698c7814eb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8c5 expref: 11 pid: 6647 timeout: 301 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.707241:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518147.707823:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518147.707833:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000044e0d026/0x631fd8698c7814f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8cc expref: 10 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.707843:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044e0d026/0x631fd8698c7814f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8cc expref: 10 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.707881:0:5799:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000044e0d026/0x631fd8698c7814f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8cc expref: 10 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518147.707895:0:5799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79ac380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5799:1876445627473024:192.168.206.51@tcp:105: 00000100:00100000:1.0:1789518147.707982:0:5799:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789518147.710156:0:5799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79ac380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5799:1876445627473024:192.168.206.51@tcp:105: 00010000:00010000:1.0:1789518147.710177:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518147.710222:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+10:2343:x1876445616985216:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 3080us (3537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518147.710231:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00100000:1.0:1789518147.711793:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518147.712215:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616985344 00000100:00100000:0.0:1789518147.712223:0:6653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616985344 00002000:00100000:0.0:1789518147.712268:0:6653:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff99fff79ac380 x1876445616985344/t0(0) o4->cfa1c47d-1425-4fe5-be2a-28ad5152a12d@192.168.206.51@tcp:548/0 lens 504/0 e 0 to 0 dl 1789518158 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518147.712279:0:6653:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff79ac380 with x1876445616985344 ext(0->12) 00002000:00010000:0.0:1789518147.712284:0:6653:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff79ac380 00000100:00100000:0.0:1789518147.712324:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:0.0:1789518147.712341:0:6653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+10:2342:x1876445616985344:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789518147.712723:0:6653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+12:2342:x1876445616985344:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 383us (935us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789518147.712731:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2 00002000:00100000:0.0:1789518147.712739:0:6653:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff99fff79ac380 x1876445616985344/t4294967308(0) o4->cfa1c47d-1425-4fe5-be2a-28ad5152a12d@192.168.206.51@tcp:548/0 lens 504/448 e 0 to 0 dl 1789518158 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518147.712747:0:6653:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff79ac380 with x1876445616985344 ext(0->12) 00002000:00010000:0.0:1789518147.712751:0:6653:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff79ac380 00000100:00100000:1.0:1789518147.715072:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518147.715364:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616985472 00000100:00100000:3.0:1789518147.715372:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616985472 00000100:00100000:3.0:1789518147.715451:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 124 00000100:00100000:3.0:1789518147.715461:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+61:10516:x1876445616985472:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789518147.724562:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:2.0:1789518147.724588:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:2.0:1789518147.724597:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1789518147.724603:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:2.0:1789518147.739435:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:2.0:1789518147.739450:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:2.0:1789518147.739479:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99ffc514a180 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1789518147.739484:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff4209300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99ffc514aa80 00000100:00100000:3.0:1789518147.739509:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+58:10516:x1876445616985472:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 Request processed in 24044us (24439us total) trans 0 rc 0/0 00000020:00080000:2.0:1789518147.739513:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff4209800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99fff4696400 00000100:00100000:3.0:1789518147.739529:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 124 00000004:00080000:2.0:1789518147.739551:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1789518147.739567:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99ffc514a6c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1789518147.739571:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffc6bf6900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99ffc514ac00 00000020:00080000:2.0:1789518147.739574:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffc6bf6500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99fffffb9c00 00000004:00080000:2.0:1789518147.739590:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000001:00080000:2.0:1789518147.739663:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:2.0:1789518147.739689:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:2.0:1789518147.739702:0:5844:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1789518147.739876:0:5844:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1789518147.739987:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789518147.740002:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627473152:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789518147.740052:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518147.740306:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789518147.740308:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffffd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627473408:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789518147.740320:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffffff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627473280:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789518147.740346:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518147.740378:0:8784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627473152 00000100:00100000:1.0:1789518147.740386:0:8784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627473152 00000100:00100000:0.0:1789518147.740401:0:6647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627473408 00000100:00100000:0.0:1789518147.740407:0:6647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627473408 00000100:00100000:1.0:1789518147.740426:0:8784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789518147.740435:0:8784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627473152:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789518147.740456:0:8784:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:1.0:1789518147.740491:0:8784:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa9e142, atime: 0x6aa9e143, ctime: 0x6aa9e142, blocks: 0xb 00010000:00010000:1.0:1789518147.740499:0:8784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000912e107b/0x631fd8698c7814f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.740515:0:8784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=201s v=(0 0) 00010000:00010000:1.0:1789518147.740518:0:8784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518147.740524:0:8784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000912e107b/0x631fd8698c7814f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.740539:0:8784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000912e107b/0x631fd8698c7814f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.740549:0:8784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000912e107b/0x631fd8698c7814f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.740558:0:8784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000912e107b/0x631fd8698c7814f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.740583:0:8784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518147.740669:0:7596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518147.740676:0:7596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000912e107b/0x631fd8698c7814f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518147.740686:0:7596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518147.740690:0:7596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000912e107b/0x631fd8698c7814f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518147.740702:0:7596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000912e107b/0x631fd8698c7814f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518147.740718:0:7596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000912e107b/0x631fd8698c7814f9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518147.740739:0:7596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000912e107b/0x631fd8698c7814f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518147.740759:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518147.740761:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518147.740763:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518147.740862:0:6647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789518147.740872:0:6647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffffc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627473408:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789518147.740992:0:6647:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789518147.740996:0:6647:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789518148 00002000:00010000:0.0:1789518147.740999:0:6647:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789518147.741001:0:6647:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789518148 -> 1789518148 00002000:00010000:0.0:1789518147.741003:0:6647:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789518147.741047:0:6647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffffc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3280:x1876445627473408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 177us (702us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789518147.741054:0:6647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:3.0:1789518147.741122:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99ffffffd180/2, rc 0, transno 4294967309 00000100:00100000:3.0:1789518147.741129:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffffd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627473408:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789518147.741701:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518147.741778:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627473280 00000100:00100000:0.0:1789518147.741783:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627473280 00000100:00100000:0.0:1789518147.741847:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789518147.741855:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3282:x1876445627473280:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789518147.741876:0:6648:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1789518147.741888:0:6648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae9de4e7/0x631fd8698c781500 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.741904:0:6648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce6b5ba9/0x631fd8698c7812b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc824 expref: 11 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.741913:0:6648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789518147.741918:0:6648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518147.741922:0:6648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae9de4e7/0x631fd8698c781500 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.741965:0:6648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ce6b5ba9/0x631fd8698c7812b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc824 expref: 11 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.741980:0:6648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ce6b5ba9/0x631fd8698c7812b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc824 expref: 11 pid: 8784 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518147.741993:0:6648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffffce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6648:1876445627473536:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518147.742065:0:6648:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8116f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789518147.742110:0:8784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3283:x1876445627473152:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1674us (2056us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789518147.742119:0:8784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789518147.742338:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1789518147.742345:0:3283:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:1.0:1789518147.742419:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99ffeda6bb80, transno 4294967301 00000004:00080000:1.0:1789518147.742431:0:3283:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:1.0:1789518147.742444:0:3283:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff99ffeda7ad80 x1876445627473152/t4294967304(4294967304) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789518163 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1789518147.742464:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99ffeda7ad80/2, rc 0, transno 4294967304 00000100:00100000:1.0:1789518147.742469:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627473152:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789518147.744889:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518147.745001:0:6647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616985600 00000100:00100000:2.0:1789518147.745010:0:6647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616985600 00000100:00100000:2.0:1789518147.745097:0:6647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 43 00000100:00100000:2.0:1789518147.745108:0:6647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4001180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+12:2343:x1876445616985600:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789518147.747079:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518147.747188:0:6648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffffce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6648:1876445627473536:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518147.747219:0:6648:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ae9de4e7/0x631fd8698c781500 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518147.747310:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616985728 00000100:00100000:2.0:1789518147.747317:0:5798:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616985728 00010000:00010000:2.0:1789518147.747350:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ce6b5ba9/0x631fd8698c7812b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc824 expref: 13 pid: 8784 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518147.747511:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 58 00000100:00100000:2.0:1789518147.747520:0:5798:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc556b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+13:2343:x1876445616985728:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518147.747533:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518147.747539:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ce6b5ba9/0x631fd8698c7812b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc824 expref: 13 pid: 8784 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518147.747552:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ce6b5ba9/0x631fd8698c7812b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc824 expref: 13 pid: 8784 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518147.747589:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce6b5ba9/0x631fd8698c7812b4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc824 expref: 13 pid: 8784 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518147.747604:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518147.747608:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518147.747653:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae9de4e7/0x631fd8698c781500 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518147.747663:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae9de4e7/0x631fd8698c781500 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518147.747687:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518147.747735:0:5798:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc556b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+12:2343:x1876445616985728:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 215us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518147.747742:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 58 00010000:00010000:2.0:1789518147.747837:0:6648:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ae9de4e7/0x631fd8698c781500 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518147.747847:0:6648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae9de4e7/0x631fd8698c781500 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518147.747858:0:6648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae9de4e7/0x631fd8698c781500 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518147.747867:0:6648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae9de4e7/0x631fd8698c781500 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518147.747890:0:6648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789518147.749071:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3282:x1876445627473280:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7214us (7368us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789518147.749080:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:2.0:1789518147.749104:0:7595:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518147.749110:0:7595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae9de4e7/0x631fd8698c781500 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518147.749120:0:7595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518147.749124:0:7595:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae9de4e7/0x631fd8698c781500 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518147.749134:0:7595:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae9de4e7/0x631fd8698c781500 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518147.749149:0:7595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae9de4e7/0x631fd8698c781500 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518147.749156:0:7595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae9de4e7/0x631fd8698c781500 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518147.749174:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518147.749176:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518147.749178:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789518147.749311:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fffffff100/2, rc 0, transno 4294967310 00000100:00100000:0.0:1789518147.749325:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffffff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627473280:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1789518147.764560:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1789518147.764573:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:2.0:1789518147.764819:0:6647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4001180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2343:x1876445616985600:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 Request processed in 19709us (19934us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518147.764841:0:6647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 43 00000100:00100000:1.0:1789518147.767348:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518147.767533:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616985984 00000100:00100000:3.0:1789518147.767542:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616985984 00000100:00100000:3.0:1789518147.767685:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 125 00000100:00100000:3.0:1789518147.767695:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+15:10516:x1876445616985984:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789518147.767753:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518147.767779:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c7814e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8be expref: 15 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.767798:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99ffd8781400) 00010000:00010000:3.0:1789518147.767803:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518147.767830:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781507 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.767842:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781507 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.767851:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781507 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518147.768073:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f0053948 reply state 000000003178f380 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781507 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518147.768083:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789518147.768187:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+16:10516:x1876445616985984:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 493us (846us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1789518147.768194:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 125 00010000:00010000:1.0:1789518147.769492:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781507 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.769503:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781507 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.769509:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781507 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.769514:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518147.769518:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781507 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.769524:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781507 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.769534:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99ffd8781400) 00010000:00010000:1.0:1789518147.769537:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518147.769540:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781507 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.769545:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781507 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518147.770361:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518147.770498:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616986112 00000100:00100000:2.0:1789518147.770506:0:6649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616986112 00000100:00100000:2.0:1789518147.770544:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:2.0:1789518147.770553:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff64ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2343:x1876445616986112:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789518147.770755:0:6649:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789518147.770759:0:6649:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789518148 -> 1789518147 00002000:00010000:2.0:1789518147.770761:0:6649:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789518147 00002000:00010000:2.0:1789518147.770763:0:6649:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789518148 -> 1789518147 00002000:00010000:2.0:1789518147.770765:0:6649:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789518147.771141:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff64ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:2343:x1876445616986112:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 587us (782us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789518147.771149:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:3.0:1789518147.776986:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518147.777088:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616986368 00000100:00100000:1.0:1789518147.777100:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616986368 00000100:00100000:1.0:1789518147.777270:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 126 00000100:00100000:1.0:1789518147.777280:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffff2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+15:10516:x1876445616986368:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789518147.777356:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c78150e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.777371:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7814c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8b0 expref: 15 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.777380:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c78150e lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.777413:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7814c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8b0 expref: 15 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.777440:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7814c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8b0 expref: 15 pid: 5813 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518147.777454:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff64d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1876445627473664:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518147.777562:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab3240 going to sleep for 11 seconds 00000100:00100000:0.0:1789518147.781072:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518147.781110:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff64d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1876445627473664:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518147.781142:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c78150e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518147.781209:0:7597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616986496 00000100:00100000:2.0:1789518147.781217:0:7597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616986496 00010000:00010000:2.0:1789518147.781250:0:7597:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7814c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8b0 expref: 16 pid: 5813 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518147.781288:0:7597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 59 00000100:00100000:2.0:1789518147.781297:0:7597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffffce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+16:2342:x1876445616986496:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518147.781311:0:7597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518147.781318:0:7597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7814c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8b0 expref: 16 pid: 5813 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518147.781330:0:7597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7814c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8b0 expref: 16 pid: 5813 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518147.781363:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7814c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8b0 expref: 16 pid: 5813 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518147.781377:0:7597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99ffd8781400) 00010000:00010000:2.0:1789518147.781382:0:7597:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c78150e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518147.781390:0:7597:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c78150e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518147.781398:0:7597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c78150e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518147.781464:0:7597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518147.781513:0:7597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffffce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+15:2342:x1876445616986496:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 216us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518147.781520:0:7597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 59 00010000:00010000:0.0:1789518147.781784:0:5813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c78150e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.781791:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c78150e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.781816:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c78150e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.781823:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c78150e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.781830:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c78150e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.781835:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518147.781839:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c78150e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.781846:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c78150e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.781856:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99ffd8781400) 00010000:00010000:0.0:1789518147.781859:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789518147.781863:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c78150e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.781869:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c78150e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518147.782018:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffff2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+14:10516:x1876445616986368:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 Request processed in 4739us (5040us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789518147.782027:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 126 00000100:00100000:0.0:1789518147.786582:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518147.786961:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616986624 00000100:00100000:2.0:1789518147.786971:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616986624 00000100:00100000:2.0:1789518147.787109:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 45 00000100:00100000:2.0:1789518147.787120:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:2343:x1876445616986624:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789518147.787164:0:6648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c781515 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518147.787183:0:6648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000044e0d026/0x631fd8698c7814f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8cc expref: 7 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518147.787229:0:6648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518147.787234:0:6648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518147.787238:0:6648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c781515 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518147.787271:0:6648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000044e0d026/0x631fd8698c7814f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8cc expref: 7 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518147.787285:0:6648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000044e0d026/0x631fd8698c7814f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8cc expref: 7 pid: 6648 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518147.787301:0:6648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6648:1876445627473792:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518147.787375:0:6648:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc74320c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518147.793505:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518147.793587:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616986752 00000100:00100000:3.0:1789518147.793596:0:5798:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616986752 00010000:00010000:3.0:1789518147.793670:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000044e0d026/0x631fd8698c7814f2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8cc expref: 8 pid: 6648 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518147.793741:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 60 00000100:00100000:1.0:1789518147.793753:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+8:2343:x1876445616986752:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518147.793787:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518147.793808:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000044e0d026/0x631fd8698c7814f2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8cc expref: 8 pid: 6648 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.793823:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000044e0d026/0x631fd8698c7814f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8cc expref: 8 pid: 6648 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.793848:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518147.793852:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518147.793859:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c781515 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.793869:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c781515 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.793890:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518147.793983:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+8:2343:x1876445616986752:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 232us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518147.793991:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 60 00010000:00010000:0.0:1789518147.794270:0:6648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044e0d026/0x631fd8698c7814f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8cc expref: 7 pid: 6648 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518147.794286:0:6648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffc5f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6648:1876445627473792:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518147.794307:0:6648:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c781515 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.794317:0:6648:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c781515 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.794324:0:6648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c781515 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.794348:0:6648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c781515 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.794357:0:6648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c781515 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.794365:0:6648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c781515 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.794383:0:6648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518147.794388:0:6648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c781515 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.794396:0:6648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c781515 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.794408:0:6648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c781515 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.794415:0:6648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c781515 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518147.794476:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2343:x1876445616986624:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 Request processed in 7358us (7902us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518147.794484:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 45 00000100:00100000:2.0:1789518147.797347:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518147.797454:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616987008 00000100:00100000:0.0:1789518147.797466:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616987008 00000100:00100000:0.0:1789518147.797742:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 127 00000100:00100000:0.0:1789518147.797755:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+14:10516:x1876445616987008:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789518147.797823:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78151c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.797839:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78151c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.797865:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78151c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.798063:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781523 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.798074:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7814d6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8b7 expref: 15 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.798082:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781523 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.798128:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7814d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8b7 expref: 15 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.798142:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7814d6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8b7 expref: 15 pid: 8051 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518147.798155:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffffe300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1876445627473920:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518147.798278:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8116180 going to sleep for 11 seconds 00000100:00100000:0.0:1789518147.800903:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffffe300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1876445627473920:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518147.800928:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781523 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518147.801379:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518147.801429:0:7597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616987136 00000100:00100000:1.0:1789518147.801436:0:7597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616987136 00010000:00010000:1.0:1789518147.801463:0:7597:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7814d6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8b7 expref: 16 pid: 8051 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518147.801498:0:7597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 61 00000100:00100000:1.0:1789518147.801507:0:7597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+16:2342:x1876445616987136:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518147.801536:0:7597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518147.801544:0:7597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7814d6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8b7 expref: 16 pid: 8051 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.801556:0:7597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7814d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8b7 expref: 16 pid: 8051 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.801575:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7814d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8b7 expref: 16 pid: 8051 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.801589:0:7597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99ffd8781400) 00010000:00010000:1.0:1789518147.801594:0:7597:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781523 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.801602:0:7597:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781523 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.801610:0:7597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781523 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.801661:0:7597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518147.801673:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781523 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.801682:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781523 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518147.801699:0:7597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+15:2342:x1876445616987136:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 192us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518147.801708:0:7597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 61 00000001:00080000:0.0:1789518147.801842:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1789518147.801990:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1789518147.802028:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1789518147.802090:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffffe300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5812:1876445627474048:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789518147.802127:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518147.802162:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8116a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789518147.802544:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627474048 00000100:00100000:3.0:1789518147.802550:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627474048 00000100:00100000:3.0:1789518147.802590:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789518147.802597:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5812:x1876445627474048:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789518147.802690:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5812:x1876445627474048:12345-0@lo:1000:mdt00_001.0 Request processed in 93us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518147.802697:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789518147.802872:0:5812:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1789518147.802877:0:5812:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:0.0:1789518147.802891:0:5812:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99ffffffd180, transno 4294967309 00000100:00100000:0.0:1789518147.802907:0:5812:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff99fffffff100 x1876445627473280/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789518163 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518147.802918:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffffe300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5812:1876445627474048:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1789518147.803345:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1789518147.803391:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffffe300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5812:1876445627474176:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789518147.803416:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518147.803430:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8116180 going to sleep for 11 seconds 00000100:00100000:2.0:1789518147.803536:0:12017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627474176 00000100:00100000:2.0:1789518147.803541:0:12017:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627474176 00000100:00100000:2.0:1789518147.803575:0:12017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789518147.803587:0:12017:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5812:x1876445627474176:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789518147.803767:0:12017:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:5812:x1876445627474176:12345-0@lo:1000:mdt00_001.0 Request processed in 186us (349us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789518147.803774:0:12017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789518147.803961:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffffe300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5812:1876445627474176:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1789518147.803988:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781523 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.803998:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781523 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.804012:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781523 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.804019:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518147.804023:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781523 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.804030:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781523 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.804042:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99ffd8781400) 00010000:00010000:1.0:1789518147.804046:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789518147.804050:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781523 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.804055:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781523 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.804079:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781466 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.804087:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781466 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.804092:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781466 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.804097:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518147.804099:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781466 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.804114:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781466 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.804122:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:1.0:1789518147.804124:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789518147.804130:0:5812:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c78146d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc89b expref: 18 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.804139:0:5812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c78146d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc89b expref: 18 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.804148:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c78146d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc89b expref: 18 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.804171:0:5812:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c78146d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc89b expref: 18 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518147.804181:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff64d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1876445627474304:192.168.206.51@tcp:105: 00000100:00100000:1.0:1789518147.804242:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab3240 going to sleep for 11 seconds 00000100:00100000:1.0:1789518147.807400:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff64d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1876445627474304:192.168.206.51@tcp:105: 00000100:00100000:2.0:1789518147.807412:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:1.0:1789518147.807430:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781466 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.807441:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781466 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.807472:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c78152a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.807501:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c78152a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.807512:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c78152a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.807523:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c78152a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.807530:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c78152a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.807536:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c78152a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.807542:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f6e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518147.807546:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c78152a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.807553:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c78152a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.807563:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:1.0:1789518147.807566:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518147.807569:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c78152a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.807576:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c78152a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.807586:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78151c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.807598:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78151c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.807604:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78151c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.807609:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518147.807635:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78151c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.807642:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78151c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.807650:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:1.0:1789518147.807652:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789518147.807654:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78151c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.807660:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78151c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518147.807878:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+18:10516:x1876445616987008:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 10125us (10536us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1789518147.807887:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 127 00000020:00080000:1.0:1789518147.807893:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1789518147.808042:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616987264 00000100:00100000:3.0:1789518147.808050:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616987264 00000100:00100000:3.0:1789518147.808087:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:3.0:1789518147.808096:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+18:10515:x1876445616987264:12345-192.168.206.51@tcp:49:lfs.0 00000100:00100000:3.0:1789518147.808195:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+18:10515:x1876445616987264:12345-192.168.206.51@tcp:49:lfs.0 Request processed in 100us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518147.808202:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 31 00000040:00080000:2.0:1789518147.808452:0:11633:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789518147.808464:0:11633:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518147.809008:0:11633:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1789518147.809016:0:11633:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789518147.810005:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518147.810079:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616987520 00000100:00100000:3.0:1789518147.810086:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616987520 00000100:00100000:3.0:1789518147.810131:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:3.0:1789518147.810139:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfa70850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+18:10516:x1876445616987520:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789518147.810405:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518147.810535:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616987776 00000100:00100000:2.0:1789518147.810539:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616987776 00000100:00100000:2.0:1789518147.810571:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 128 00000100:00100000:2.0:1789518147.810580:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffffff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+20:10515:x1876445616987776:12345-192.168.206.51@tcp:58:lfs.0 00000040:00080000:2.0:1789518147.811252:0:8051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000004:00080000:0.0:1789518147.811382:0:5814:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:2.0:1789518147.811416:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffffff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+20:10515:x1876445616987776:12345-192.168.206.51@tcp:58:lfs.0 Request processed in 835us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518147.811425:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 128 00000001:00080000:0.0:1789518147.811478:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1789518147.811519:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c781531 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.811533:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c781531 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.811543:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c781531 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.811561:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c781531 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.811568:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c781531 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.811573:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c781531 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518147.811596:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518147.811660:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518147.811668:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c781531 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.811677:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bdc00 already unused, calling callback (ffffffffc15168b0) 00000100:00100000:0.0:1789518147.811683:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfa70850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+20:10516:x1876445616987520:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 1543us (1680us total) trans 4294967408 rc 0/0 00010000:00010000:1.0:1789518147.811689:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c781531 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518147.811695:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 32 00000020:00080000:0.0:1789518147.811700:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789518147.811704:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c781531 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.811716:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99ffd2a17700) 00010000:00010000:1.0:1789518147.811718:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789518147.811722:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c781531 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.811726:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c781531 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518147.811740:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518147.811741:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518147.811742:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518147.835529:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518147.835647:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616987904 00000100:00100000:3.0:1789518147.835657:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616987904 00000100:00100000:3.0:1789518147.835714:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 129 00000100:00100000:3.0:1789518147.835725:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+20:10518:x1876445616987904:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518147.835747:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518147.835766:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781538 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc8d3 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.835823:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78153f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.835837:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78153f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.835849:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78153f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.835864:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781546 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.835871:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781546 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.835878:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781546 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.836102:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c78154d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.836113:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781458 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc894 expref: 21 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.836129:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c78154d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.836159:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781458 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc894 expref: 21 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.836173:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781458 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc894 expref: 21 pid: 5811 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518147.836186:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffff28380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1876445627474432:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518147.836408:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec1b57600 going to sleep for 11 seconds 00000100:00100000:1.0:1789518147.837921:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffff28380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1876445627474432:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518147.837969:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c78154d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518147.838191:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518147.838258:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616988160 00000100:00100000:0.0:1789518147.838269:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616988160 00000100:00100000:0.0:1789518147.838325:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:0.0:1789518147.838335:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+22:5576:x1876445616988160:12345-192.168.206.51@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789518147.838530:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+23:5576:x1876445616988160:12345-192.168.206.51@tcp:35:ldlm_bl.0 Request processed in 195us (339us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1789518147.838538:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:3.0:1789518147.840023:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518147.840187:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616988288 00000100:00100000:2.0:1789518147.840197:0:5798:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616988288 00010000:00010000:2.0:1789518147.840243:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781458 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc894 expref: 23 pid: 5811 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518147.840285:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 62 00000100:00100000:2.0:1789518147.840294:0:5798:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd8067850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+23:2343:x1876445616988288:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518147.840310:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518147.840317:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781458 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc894 expref: 23 pid: 5811 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518147.840331:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781458 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc894 expref: 23 pid: 5811 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518147.840376:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781458 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc894 expref: 23 pid: 5811 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518147.840392:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:2.0:1789518147.840397:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c78154d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518147.840407:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c78154d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518147.840414:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c78154d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518147.840448:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518147.840512:0:5798:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd8067850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+22:2343:x1876445616988288:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 219us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518147.840521:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 62 00010000:00010000:3.0:1789518147.840726:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c78154d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.840735:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c78154d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518147.840787:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789518147.840792:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518147.840813:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c78154d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.840826:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c78154d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.840836:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78153f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.840856:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78153f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.840869:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78153f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.840875:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518147.840880:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78153f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.840888:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78153f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.840898:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ffd8781a00) 00010000:00010000:3.0:1789518147.840901:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518147.840905:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78153f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.840911:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78153f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.840923:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781546 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.840930:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781546 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.840936:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781546 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.840942:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518147.841233:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781546 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.841240:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781546 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.841249:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99ffd8781300) 00010000:00010000:3.0:1789518147.841251:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518147.841254:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781546 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.841316:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781546 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.841365:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781538 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8d3 expref: 22 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.841381:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c78154d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8d3 expref: 21 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518147.841389:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:3.0:1789518147.841392:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518147.841395:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17c00, rc 0) 00000100:00100000:3.0:1789518147.841439:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+21:10518:x1876445616987904:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 5716us (5919us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518147.841447:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 129 00010000:00010000:3.0:1789518148.020028:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789518148.277430:0:12058:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789518148.277438:0:12058:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518148.277480:0:12058:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789518148.277490:0:12058:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1789518148.852689:0:11633:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789518148.852698:0:11633:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518148.852730:0:11633:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789518148.852736:0:11633:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789518148.852849:0:11633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f0a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11633:1876445627474560:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789518148.853030:0:11633:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd811d480 going to sleep for 11 seconds 00000100:00100000:3.0:1789518148.856609:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518148.856857:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616988416 00000100:00100000:0.0:1789518148.856866:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616988416 00000100:00100000:0.0:1789518148.856950:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 130 00000100:00100000:0.0:1789518148.856961:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffff28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+22:10530:x1876445616988416:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789518148.856994:0:5813:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00080000:3.0:1789518148.857058:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518148.857090:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffff28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+22:10530:x1876445616988416:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 131us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518148.857110:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 130 00000100:00100000:2.0:1789518148.857766:0:11633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffc5f0a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11633:1876445627474560:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789518148.862223:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518148.862325:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616988672 00000100:00100000:1.0:1789518148.862335:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616988672 00000100:00100000:1.0:1789518148.862515:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 131 00000100:00100000:1.0:1789518148.862526:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+21:10530:x1876445616988672:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518148.862546:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518148.862582:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c781554 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc8da expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518148.862697:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c78155b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518148.862721:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c78155b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518148.862732:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c78155b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518148.862743:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789518148.862896:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c781554 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8da expref: 24 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518148.862913:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c78155b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8da expref: 23 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518148.862922:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:1.0:1789518148.862924:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789518148.862928:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f7600, rc 0) 00000100:00100000:1.0:1789518148.863000:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+23:10530:x1876445616988672:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 476us (787us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1789518148.863007:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 131 00000100:00100000:3.0:1789518148.866238:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518148.867379:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616988800 00000100:00100000:0.0:1789518148.867391:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616988800 00000100:00100000:0.0:1789518148.867454:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:0.0:1789518148.867465:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffff2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+23:2343:x1876445616988800:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518148.867485:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518148.867507:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c78155b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8da expref: 23 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518148.867524:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:0.0:1789518148.867529:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518148.867587:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffff2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+22:2343:x1876445616988800:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 123us (1356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518148.867594:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:2.0:1789518148.867990:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518148.868340:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616989056 00000100:00100000:0.0:1789518148.868346:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616989056 00000100:00100000:1.0:1789518148.868508:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 132 00000100:00100000:1.0:1789518148.868521:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+22:10530:x1876445616989056:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789518148.868576:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c781569 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518148.868589:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c781569 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518148.868596:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c781569 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518148.868769:0:8051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c781569 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518148.868777:0:8051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c781569 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518148.868784:0:8051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c781569 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518148.868802:0:8051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f6a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518148.868812:0:8051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c781569 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518148.868820:0:8051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c781569 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518148.868897:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:1.0:1789518148.868901:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789518148.868906:0:8051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c781569 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518148.868913:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c781569 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518148.869271:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+23:10530:x1876445616989056:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 752us (1280us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1789518148.869279:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 132 00000040:00080000:2.0:1789518148.869468:0:11633:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789518148.869472:0:11633:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518148.870051:0:11633:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789518148.870059:0:11633:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789518148.872928:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518148.873017:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616989312 00000100:00100000:1.0:1789518148.873027:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616989312 00000100:00100000:1.0:1789518148.873122:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:1.0:1789518148.873143:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffff28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+23:10530:x1876445616989312:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789518148.873346:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffff28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+24:10530:x1876445616989312:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 204us (433us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1789518148.873353:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:3.0:1789518149.005690:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518149.005810:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616989440 00000100:00100000:2.0:1789518149.005825:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616989440 00000100:00100000:2.0:1789518149.005898:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 266 00000100:00100000:2.0:1789518149.005908:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7647450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+13:2342:x1876445616989440:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518149.006002:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7647450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+13:2342:x1876445616989440:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 94us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518149.006010:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 266 00000100:00100000:3.0:1789518149.006841:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518149.006883:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518149.006954:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518149.007118:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616989696 00000100:00100000:1.0:1789518149.007118:0:8784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616989568 00000100:00100000:2.0:1789518149.007128:0:6649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616989696 00000100:00100000:1.0:1789518149.007128:0:8784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616989568 00000100:00100000:2.0:1789518149.007197:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:2.0:1789518149.007208:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffff29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2342:x1876445616989696:12345-192.168.206.51@tcp:400:kworker.0 00000100:00080000:3.0:1789518149.007210:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789518149.007214:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518149.007276:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffff29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2342:x1876445616989696:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 70us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518149.007284:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:2.0:1789518149.007303:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00100000:2.0:1789518149.007309:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffff2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2342:x1876445616989568:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518149.007315:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616989824 00000100:00100000:0.0:1789518149.007320:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616989824 00000100:00100000:2.0:1789518149.007335:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffff2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2342:x1876445616989568:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 27us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518149.007341:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00100000:0.0:1789518149.007370:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 86 00000100:00080000:1.0:1789518149.007405:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518149.007580:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffff29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2342:x1876445616989824:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518149.007764:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffff29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2342:x1876445616989824:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 387us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518149.007774:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 86 00010000:00010000:2.0:1789518149.042828:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518149.235056:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518149.236289:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627474688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518149.236361:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518149.236529:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627474688 00000100:00100000:2.0:1789518149.236543:0:6652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627474688 00000100:00100000:2.0:1789518149.236628:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789518149.236640:0:6652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffff2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627474688:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789518149.236684:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1789518149.236710:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789518149.236773:0:6652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffff2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627474688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518149.236781:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789518149.236829:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffc5f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627474688:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1789518149.796868:0:12110:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789518149.796880:0:12110:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518149.796947:0:12110:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789518149.796956:0:12110:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1789518149.875491:0:11633:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789518149.875505:0:11633:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518149.875545:0:11633:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789518149.875553:0:11633:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789518149.881510:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518149.881659:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616990080 00000100:00100000:2.0:1789518149.881674:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616990080 00000100:00100000:2.0:1789518149.881758:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 133 00000100:00100000:2.0:1789518149.881772:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffffd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+24:10550:x1876445616990080:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518149.881809:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518149.881839:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c781570 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc8e1 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518149.881987:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c781577 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518149.882006:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c781577 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518149.882022:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c781577 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518149.882053:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789518149.882208:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c781570 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8e1 expref: 27 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518149.882227:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c781577 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8e1 expref: 26 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518149.882236:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:2.0:1789518149.882238:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789518149.882243:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697800, rc 0) 00000100:00100000:2.0:1789518149.882335:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffffd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+26:10550:x1876445616990080:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 567us (840us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1789518149.882342:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 133 00000100:00100000:1.0:1789518149.890200:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518149.890272:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616990208 00000100:00100000:2.0:1789518149.890290:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616990208 00000100:00100000:2.0:1789518149.890420:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 134 00000100:00100000:2.0:1789518149.890435:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff64d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+26:10550:x1876445616990208:12345-192.168.206.51@tcp:54:lfs.0 00010000:00010000:2.0:1789518149.890552:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781585 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518149.890573:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518149.890586:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518149.890649:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518149.890665:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781585 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518149.890690:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781585 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518149.890698:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518149.890705:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781585 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518149.890715:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781585 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518149.890730:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:2.0:1789518149.890733:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789518149.890739:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781585 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518149.890746:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781585 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518149.890846:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff64d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+26:10550:x1876445616990208:12345-192.168.206.51@tcp:54:lfs.0 Request processed in 415us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518149.890854:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 134 00000100:00100000:0.0:1789518149.935890:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518149.935961:0:8784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616990336 00000100:00100000:1.0:1789518149.935974:0:8784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616990336 00000100:00100000:1.0:1789518149.936045:0:8784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 46 00000100:00100000:1.0:1789518149.936056:0:8784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffffea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2342:x1876445616990336:12345-192.168.206.51@tcp:101:cat.0 00010000:00010000:1.0:1789518149.936079:0:8784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518149.936105:0:8784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f6909c0/0x631fd8698c78158c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc8e8 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789518149.936138:0:8784:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa9e143, atime: 0x6aa9e143, ctime: 0x6aa9e143, blocks: 0xb 00010000:00010000:1.0:1789518149.936177:0:8784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=203s v=(0 0) 00010000:00010000:1.0:1789518149.936183:0:8784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518149.936192:0:8784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f6909c0/0x631fd8698c78158c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8e8 expref: 7 pid: 8784 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518149.936212:0:8784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004f6909c0/0x631fd8698c78158c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8e8 expref: 7 pid: 8784 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518149.936244:0:8784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f6200, rc 0) 00000100:00100000:1.0:1789518149.936307:0:8784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffffea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:2342:x1876445616990336:12345-192.168.206.51@tcp:101:cat.0 Request processed in 254us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518149.936313:0:8784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 46 00000100:00100000:3.0:1789518149.940198:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518149.940261:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616990464 00000100:00100000:2.0:1789518149.940275:0:6655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616990464 00002000:00100000:2.0:1789518149.940330:0:6655:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff99fffff2ad80 x1876445616990464/t0(0) o3->cfa1c47d-1425-4fe5-be2a-28ad5152a12d@192.168.206.51@tcp:550/0 lens 488/0 e 0 to 0 dl 1789518160 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518149.940339:0:6655:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffff2ad80 with x1876445616990464 ext(0->4095) 00002000:00010000:2.0:1789518149.940360:0:6655:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fffff2ad80 00000100:00100000:2.0:1789518149.940421:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:2.0:1789518149.940432:0:6655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffff2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:2343:x1876445616990464:12345-192.168.206.51@tcp:3:cat.0 00000100:00100000:2.0:1789518149.940829:0:6655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffff2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:2343:x1876445616990464:12345-192.168.206.51@tcp:3:cat.0 Request processed in 398us (640us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789518149.940837:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 3 00002000:00100000:2.0:1789518149.940844:0:6655:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff99fffff2ad80 x1876445616990464/t0(0) o3->cfa1c47d-1425-4fe5-be2a-28ad5152a12d@192.168.206.51@tcp:550/0 lens 488/4536 e 0 to 0 dl 1789518160 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518149.940852:0:6655:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffff2ad80 with x1876445616990464 ext(0->4095) 00002000:00010000:2.0:1789518149.940855:0:6655:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fffff2ad80 00010000:00010000:2.0:1789518150.066886:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518151.090944:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518152.114816:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518152.307315:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627474816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518152.307373:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffff29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627475072:0@lo:400:kworker.0 00000100:00100000:3.0:1789518152.307433:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518152.307433:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518152.307524:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffff2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:824c8f07-28fa-48fd-81af-173b194570e6:3283:1876445627474944:0@lo:400:kworker.0 00000100:00100000:1.0:1789518152.307570:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518152.307604:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffff2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627475328:0@lo:400:kworker.0 00000100:00100000:1.0:1789518152.307605:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffff29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627475456:0@lo:400:kworker.0 00000100:00100000:2.0:1789518152.307672:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518152.307678:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518152.307726:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627475072 00000100:00100000:1.0:1789518152.307728:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627474944 00000100:00100000:2.0:1789518152.307736:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627475072 00000100:00100000:1.0:1789518152.307736:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627474944 00000100:00100000:1.0:1789518152.307794:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789518152.307802:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627475456 00000100:00100000:1.0:1789518152.307807:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7647050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+19:3283:x1876445627474944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518152.307808:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627475456 00000100:00100000:2.0:1789518152.307847:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789518152.307856:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffff28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627475072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518152.307884:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7647050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+19:3283:x1876445627474944:12345-0@lo:400:kworker.0 Request processed in 80us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518152.307894:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789518152.307904:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffff28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627475072:12345-0@lo:400:kworker.0 Request processed in 48us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518152.307912:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789518152.307944:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789518152.307952:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff64e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627475456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518152.307963:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffff2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:824c8f07-28fa-48fd-81af-173b194570e6:3283:1876445627474944:0@lo:400:kworker.0 00000100:00100000:2.0:1789518152.308019:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff64e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627475456:12345-0@lo:400:kworker.0 Request processed in 67us (343us total) trans 0 rc 0/0 00000100:00080000:1.0:1789518152.308023:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518152.308028:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789518152.308049:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627474816 00000100:00100000:1.0:1789518152.308054:0:6651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627474816 00000100:00100000:2.0:1789518152.308068:0:6647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627475328 00000100:00100000:2.0:1789518152.308073:0:6647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627475328 00000100:00100000:1.0:1789518152.308102:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789518152.308112:0:6651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1876445627474816:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518152.308116:0:6647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00002000:00000024:1.0:1789518152.308152:0:6651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789518152.308193:0:6651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1876445627474816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518152.308207:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1789518152.308223:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789518152.308226:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518152.308245:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffff29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627475456:0@lo:400:kworker.0 00000100:00100000:1.0:1789518152.308284:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffff2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627475200:0@lo:400:kworker.0 00000100:00100000:1.0:1789518152.308311:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518152.308338:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627475200 00000100:00100000:1.0:1789518152.308342:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627475200 00000100:00100000:1.0:1789518152.308370:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789518152.308376:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff64c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627475200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518152.308413:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff64c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627475200:12345-0@lo:400:kworker.0 Request processed in 37us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518152.308418:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1789518152.308433:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518152.308444:0:6647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627475328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518152.308449:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffff2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627475200:0@lo:400:kworker.0 00000100:00100000:1.0:1789518152.308485:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffc5f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627474816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518152.308492:0:6647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627475328:12345-0@lo:400:kworker.0 Request processed in 365us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518152.308501:0:6647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789518152.308511:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffff2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627475328:0@lo:400:kworker.0 00000100:00100000:3.0:1789518152.308813:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffff29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627475072:0@lo:400:kworker.0 00000100:00100000:3.0:1789518152.308821:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffff28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627475584:0@lo:400:kworker.0 00000100:00100000:3.0:1789518152.308864:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518152.308977:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627475584 00000100:00100000:1.0:1789518152.308981:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627475584 00000100:00100000:1.0:1789518152.309014:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789518152.309021:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff40be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3280:x1876445627475584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518152.309069:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff40be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3280:x1876445627475584:12345-0@lo:400:kworker.0 Request processed in 48us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518152.309076:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789518152.309688:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffff28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627475584:0@lo:400:kworker.0 00000100:00100000:2.0:1789518152.752018:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518152.752091:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616990592 00000100:00100000:1.0:1789518152.752101:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616990592 00000100:00100000:1.0:1789518152.752176:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 135 00000100:00100000:1.0:1789518152.752186:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+26:10196:x1876445616990592:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789518152.752284:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+26:10196:x1876445616990592:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 Request processed in 99us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518152.752293:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 135 00000100:00080000:2.0:1789518152.753395:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518152.756887:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518152.756968:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616990848 00000100:00100000:3.0:1789518152.756977:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616990848 00000100:00100000:3.0:1789518152.757027:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:3.0:1789518152.757035:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffffffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+26:10196:x1876445616990848:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789518152.757272:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffffffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+27:10196:x1876445616990848:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 236us (393us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1789518152.757279:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 35 00000001:00080000:3.0:1789518152.861823:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967409 is committed 00000020:00080000:3.0:1789518152.861846:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99ffd8116a80 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1789518152.861851:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffc6a1e000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99ffd8116d80 00000020:00080000:3.0:1789518152.861855:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffc6a1e100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99ffd078cc00 00000001:00080000:3.0:1789518152.861887:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000001:00080000:3.0:1789518152.861901:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1789518152.861910:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:3.0:1789518152.861916:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1789518152.862415:0:5844:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1789518152.863039:0:5844:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:3.0:1789518152.872210:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:3.0:1789518152.872236:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1789518152.873146:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00010000:00010000:2.0:1789518153.139684:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789518153.924247:0:12308:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 20:22:33 (1789518153) 00000100:00100000:3.0:1789518154.126290:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518154.126391:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518154.126429:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518154.126461:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518154.126514:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518154.126603:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616991488 00000100:00100000:2.0:1789518154.126643:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616991488 00000100:00080000:3.0:1789518154.126693:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518154.126703:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616991104 00000100:00100000:2.0:1789518154.126708:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616991104 00000100:00100000:3.0:1789518154.126712:0:6647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616991232 00000100:00100000:1.0:1789518154.126715:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616991360 00000100:00100000:3.0:1789518154.126719:0:6647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616991232 00000100:00100000:1.0:1789518154.126721:0:6649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616991360 00000100:00100000:2.0:1789518154.126736:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 90 00000100:00100000:2.0:1789518154.126745:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffff29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2342:x1876445616991488:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518154.126757:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 53 00000100:00100000:1.0:1789518154.126764:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffff29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2342:x1876445616991360:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518154.126775:0:6647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 54 00000100:00100000:3.0:1789518154.126787:0:6647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffff28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2342:x1876445616991232:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518154.126817:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffff29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2342:x1876445616991488:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 71us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518154.126824:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 90 00000100:00100000:2.0:1789518154.126847:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 91 00000100:00100000:2.0:1789518154.126854:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffff29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+13:2342:x1876445616991104:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518154.126932:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616990976 00000100:00100000:0.0:1789518154.126937:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616990976 00000100:00100000:0.0:1789518154.126967:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 268 00000100:00100000:0.0:1789518154.126975:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7647c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+13:2342:x1876445616990976:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518154.127960:0:6647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffff28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2342:x1876445616991232:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 1169us (1562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518154.127961:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffff29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+13:2342:x1876445616991104:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 1100us (1492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518154.127961:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffff29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2342:x1876445616991360:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 1192us (1442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518154.127975:0:6647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 54 00000100:00100000:2.0:1789518154.127988:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 91 00000100:00080000:3.0:1789518154.128034:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789518154.128039:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789518154.128042:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518154.128258:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7647c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e55716f-fc49-42ce-abad-050985078c82+13:2342:x1876445616990976:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 1282us (1974us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518154.128265:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 268 00000100:00100000:1.0:1789518154.128585:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 53 00010000:00010000:2.0:1789518154.162766:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518154.355959:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518154.355981:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627475712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518154.356046:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518154.356178:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627475712 00000100:00100000:2.0:1789518154.356186:0:6651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627475712 00000100:00100000:2.0:1789518154.356245:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789518154.356253:0:6651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffff2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627475712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789518154.356285:0:6651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789518154.356321:0:6651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffff2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627475712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518154.356329:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789518154.356420:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1789518154.356427:0:3280:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99ffeda7ad80, transno 4294967304 00000100:00080000:0.0:1789518154.359894:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518154.360091:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffc5f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627475712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518154.676465:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518154.676714:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616991744 00000100:00100000:2.0:1789518154.676724:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616991744 00000100:00100000:2.0:1789518154.676819:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 136 00000100:00100000:2.0:1789518154.676830:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffff2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+13:11259:x1876445616991744:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518154.676850:0:8051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518154.676871:0:8051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c781593 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc8ef expref: -99 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518154.676960:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78159a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518154.676974:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78159a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518154.676986:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78159a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518154.677002:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7815a1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518154.677029:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7815a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518154.677037:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7815a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518154.677254:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c7815a8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518154.677263:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c7815a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518154.677269:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c7815a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518154.677278:0:8051:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1789518154.677399:0:8051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78159a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518154.677406:0:8051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78159a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518154.677412:0:8051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78159a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518154.677418:0:8051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518154.677421:0:8051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78159a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518154.677428:0:8051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78159a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518154.677450:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99ffc2fdc100) 00010000:00010000:2.0:1789518154.677453:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518154.677458:0:8051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78159a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518154.677465:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78159a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518154.677477:0:8051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7815a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518154.677483:0:8051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7815a1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518154.677706:0:8051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7815a1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518154.677714:0:8051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518154.677717:0:8051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7815a1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518154.677722:0:8051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7815a1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518154.677731:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99ffc2ad3300) 00010000:00010000:2.0:1789518154.677734:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518154.677737:0:8051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7815a1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518154.677743:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7815a1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518154.678191:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c781593 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8ef expref: 16 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518154.678206:0:8051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c7815a8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8ef expref: 15 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518154.678213:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffc2ad3d00) 00010000:00010000:2.0:1789518154.678215:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518154.678218:0:8051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696e00, rc 0) 00000100:00100000:2.0:1789518154.678367:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffff2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+15:11259:x1876445616991744:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1538us (1910us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1789518154.678376:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 136 00000100:00100000:2.0:1789518154.682106:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518154.682160:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518154.682407:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616991872 00000100:00100000:0.0:1789518154.682425:0:5798:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616991872 00000100:00100000:0.0:1789518154.682504:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:0.0:1789518154.682515:0:5798:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+15:2344:x1876445616991872:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518154.682532:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518154.682565:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c7815a8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8ef expref: 15 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518154.682578:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616992000 00010000:00010000:0.0:1789518154.682590:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffc2ad3d00) 00000100:00100000:3.0:1789518154.682591:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616992000 00010000:00010000:0.0:1789518154.682602:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518154.682712:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 137 00000100:00100000:3.0:1789518154.682731:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+15:11259:x1876445616992000:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789518154.682734:0:5798:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+15:2344:x1876445616991872:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 211us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518154.682752:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:3.0:1789518154.682885:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+14:11259:x1876445616992000:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 Request processed in 161us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518154.682897:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 137 00000040:00080000:2.0:1789518154.995760:0:11633:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789518154.995765:0:11633:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518154.996269:0:11633:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789518154.996278:0:11633:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789518155.186766:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518155.910243:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518155.910286:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616992128 00000100:00100000:3.0:1789518155.910297:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616992128 00000100:00100000:3.0:1789518155.910359:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 138 00000100:00100000:3.0:1789518155.910369:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+14:11301:x1876445616992128:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518155.910387:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518155.910407:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7815b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc8f6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518155.910468:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7815bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518155.910499:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7815bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518155.910512:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7815bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518155.910527:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c7815c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518155.910534:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c7815c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518155.910541:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c7815c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518155.910835:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7815bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518155.910844:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7815bd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518155.910851:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7815bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518155.910864:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518155.910868:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7815bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518155.910876:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7815bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518155.910887:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2ad3000) 00010000:00010000:3.0:1789518155.910895:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518155.910901:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7815bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518155.910921:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7815bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518155.910933:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c7815c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518155.910940:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c7815c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518155.910946:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c7815c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518155.910951:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518155.910954:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c7815c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518155.910960:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c7815c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518155.910968:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff99ffd8781900) 00010000:00010000:3.0:1789518155.910970:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518155.910973:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c7815c4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518155.911687:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c7815c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518155.911724:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7815b6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8f6 expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518155.911747:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2ad3000) 00010000:00010000:3.0:1789518155.911749:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518155.911753:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7815b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8f6 expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518155.911763:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16600, rc 0) 00000100:00100000:3.0:1789518155.911825:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+14:11301:x1876445616992128:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1457us (1590us total) trans 0 rc 301/301 00000100:00100000:3.0:1789518155.911832:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 138 00000100:00100000:3.0:1789518155.917776:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518155.917873:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616992384 00000100:00100000:1.0:1789518155.917883:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616992384 00000100:00100000:1.0:1789518155.917946:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 139 00000100:00100000:1.0:1789518155.917957:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffff2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+14:11301:x1876445616992384:12345-192.168.206.51@tcp:36:lfs.0 00010000:00010000:1.0:1789518155.918007:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518155.918031:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c780f3b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc72f expref: 14 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518155.918046:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2ad3000) 00010000:00010000:1.0:1789518155.918062:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518155.918246:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c7815cb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518155.918259:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c7815cb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518155.918269:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c7815cb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518155.918282:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c7815d2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518155.918289:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c7815d2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518155.918296:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c7815d2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518155.919079:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789518155.919090:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c7815cb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518155.919098:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c7815cb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518155.919105:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c7815cb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518155.919112:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518155.919116:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c7815cb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518155.919132:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c7815cb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518155.919142:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:1.0:1789518155.919145:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518155.919149:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c7815cb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518155.919156:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c7815cb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789518155.919171:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a629bc23 reply state 000000003202da1b transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c7815d2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518155.919179:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789518155.919250:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffff2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+15:11301:x1876445616992384:12345-192.168.206.51@tcp:36:lfs.0 Request processed in 1294us (1480us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1789518155.919257:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 139 00010000:00010000:3.0:1789518155.924403:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c7815d2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518155.924418:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c7815d2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518155.924427:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c7815d2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518155.924433:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518155.924438:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c7815d2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518155.924445:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c7815d2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518155.924461:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff99ffc2fdc900) 00010000:00010000:3.0:1789518155.924464:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518155.924476:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c7815d2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518155.924482:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c7815d2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518155.985404:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518155.985572:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616992512 00000100:00100000:2.0:1789518155.985582:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616992512 00000100:00100000:2.0:1789518155.985676:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 140 00000100:00100000:2.0:1789518155.985687:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffff29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+14:11309:x1876445616992512:12345-192.168.206.51@tcp:101:lctl.0 00010000:00010000:2.0:1789518155.985710:0:8051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518155.985731:0:8051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7815d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc8fd expref: -99 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518155.985804:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c7815e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518155.985816:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c7815e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518155.985828:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c7815e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518155.985860:0:8051:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789518155.985864:0:8051:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518155.985881:0:8051:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c7815e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518155.985914:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7815d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8fd expref: 16 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518155.985932:0:8051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c7815e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8fd expref: 15 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518155.985941:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2ad3f00) 00010000:00010000:2.0:1789518155.985943:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518155.985947:0:8051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696c00, rc 0) 00000100:00100000:2.0:1789518155.986006:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffff29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+15:11309:x1876445616992512:12345-192.168.206.51@tcp:101:lctl.0 Request processed in 322us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518155.986014:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 140 00000100:00100000:2.0:1789518156.023088:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518156.023211:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616992640 00000100:00100000:1.0:1789518156.023221:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616992640 00000100:00080000:0.0:1789518156.023313:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518156.023338:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 141 00000100:00100000:1.0:1789518156.023349:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+15:11315:x1876445616992640:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:1.0:1789518156.023367:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518156.023386:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c7815e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc904 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.023446:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7815ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.023477:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7815ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.023490:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7815ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.023506:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c7815f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.023513:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c7815f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.023520:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c7815f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.023661:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c7815fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.023670:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c7815fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.023677:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c7815fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518156.023702:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789518156.023706:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518156.023723:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c7815fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.023737:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7815ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.023769:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7815ee lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.023776:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7815ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.023781:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518156.023786:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7815ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.023793:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7815ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.023809:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2ad3f00) 00010000:00010000:1.0:1789518156.023812:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518156.023817:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7815ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.023822:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7815ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.023886:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c7815f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.023893:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c7815f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.023899:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c7815f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.023913:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518156.023923:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c7815f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.023933:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c7815f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.023943:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff99ffc2fdcd00) 00010000:00010000:1.0:1789518156.023945:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518156.023949:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c7815f5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.023955:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c7815f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.023988:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c7815e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc904 expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.024002:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c7815fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc904 expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.024009:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99ffc2fdc600) 00010000:00010000:1.0:1789518156.024012:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789518156.024014:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f6a00, rc 0) 00000100:00100000:1.0:1789518156.024076:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+16:11315:x1876445616992640:12345-192.168.206.51@tcp:101:bash.0 Request processed in 728us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518156.024083:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 141 00000100:00100000:0.0:1789518156.027340:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518156.027585:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616992896 00000100:00100000:3.0:1789518156.027594:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616992896 00000100:00100000:3.0:1789518156.027789:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 142 00000100:00100000:3.0:1789518156.027800:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffffff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+16:11315:x1876445616992896:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:3.0:1789518156.027821:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518156.027840:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781603 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc90b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.027966:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78160a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.027981:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78160a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.027993:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78160a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.028007:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781611 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.028014:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781611 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.028020:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781611 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789518156.028970:0:5812:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1789518156.029135:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781618 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.029147:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781618 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.029155:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781618 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.029187:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78160a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.029195:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78160a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.029201:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78160a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.029207:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518156.029211:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78160a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.029218:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78160a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.029227:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99ffc2fdc600) 00010000:00010000:3.0:1789518156.029230:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518156.029234:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78160a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.029249:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78160a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518156.029261:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c8e4fe7b reply state 0000000064eba9c9 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781611 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518156.029282:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789518156.029311:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781603 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc90b expref: 19 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.029325:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781618 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc90b expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.029332:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffd8781200) 00010000:00010000:3.0:1789518156.029334:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518156.029336:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16800, rc 0) 00000100:00100000:3.0:1789518156.029399:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffffff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+19:11315:x1876445616992896:12345-192.168.206.51@tcp:101:bash.0 Request processed in 1601us (2068us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1789518156.029407:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 142 00010000:00010000:1.0:1789518156.034797:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781611 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.034814:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781611 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.034835:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781611 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.034842:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518156.034847:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781611 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.034856:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781611 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.034870:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99ffd8781900) 00010000:00010000:1.0:1789518156.034873:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518156.034888:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781611 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.034895:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781611 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518156.036014:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518156.036198:0:6647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616993024 00000100:00100000:3.0:1789518156.036209:0:6647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616993024 00000100:00100000:3.0:1789518156.036503:0:6647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:3.0:1789518156.036514:0:6647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffffc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2343:x1876445616993024:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:3.0:1789518156.036531:0:6647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518156.036548:0:6647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0a9c375/0x631fd8698c781626 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc912 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789518156.036589:0:6647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518156.036609:0:6647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=210s v=(0 0) 00000100:00080000:0.0:1789518156.037141:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789518156.039684:0:6647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518156.039701:0:6647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0a9c375/0x631fd8698c781626 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc912 expref: 6 pid: 6647 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.039735:0:6647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0a9c375/0x631fd8698c781626 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc912 expref: 6 pid: 6647 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.039750:0:6647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16c00, rc 0) 00000100:00100000:3.0:1789518156.039813:0:6647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffffc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2343:x1876445616993024:12345-192.168.206.51@tcp:101:bash.0 Request processed in 3299us (3805us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518156.039821:0:6647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:3.0:1789518156.042278:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518156.042416:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616993152 00000100:00100000:0.0:1789518156.042430:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616993152 00000100:00100000:0.0:1789518156.042482:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:0.0:1789518156.042558:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffff2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:11315:x1876445616993152:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:0.0:1789518156.042576:0:6648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518156.043405:0:6648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e16297d1/0x631fd8698c78162d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc919 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518156.043442:0:6648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0a9c375/0x631fd8698c781626 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc912 expref: 7 pid: 6647 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518156.043452:0:6648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518156.043456:0:6648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518156.043461:0:6648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e16297d1/0x631fd8698c78162d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc919 expref: 7 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518156.043549:0:6648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a0a9c375/0x631fd8698c781626 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc912 expref: 7 pid: 6647 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518156.043564:0:6648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a0a9c375/0x631fd8698c781626 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc912 expref: 7 pid: 6647 timeout: 310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518156.043577:0:6648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffffd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6648:1876445627475840:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518156.043756:0:6648:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a6be40 going to sleep for 11 seconds 00000100:00100000:2.0:1789518156.047729:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518156.047830:0:7597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616993280 00000100:00100000:1.0:1789518156.047838:0:7597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616993280 00010000:00010000:1.0:1789518156.047873:0:7597:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a0a9c375/0x631fd8698c781626 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc912 expref: 8 pid: 6647 timeout: 310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518156.047918:0:7597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00100000:1.0:1789518156.047927:0:7597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+8:2343:x1876445616993280:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518156.047940:0:7597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518156.047961:0:7597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a0a9c375/0x631fd8698c781626 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc912 expref: 8 pid: 6647 timeout: 310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.047986:0:7597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a0a9c375/0x631fd8698c781626 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc912 expref: 8 pid: 6647 timeout: 310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.048009:0:7597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518156.048018:0:7597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518156.048026:0:7597:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e16297d1/0x631fd8698c78162d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc919 expref: 8 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.048035:0:7597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e16297d1/0x631fd8698c78162d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc919 expref: 8 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.048080:0:7597:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e16297d1/0x631fd8698c78162d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc919 expref: 8 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518156.048099:0:7597:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff64ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7597:1876445627475968:192.168.206.51@tcp:105: 00000100:00100000:1.0:1789518156.048216:0:7597:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee58ee40 going to sleep for 11 seconds 00010000:00010000:0.0:1789518156.048254:0:6648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0a9c375/0x631fd8698c781626 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc912 expref: 8 pid: 6647 timeout: 310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518156.048271:0:6648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffffd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6648:1876445627475840:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518156.048300:0:6648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e16297d1/0x631fd8698c78162d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc919 expref: 7 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518156.048311:0:6648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bce00, rc 0) 00000100:00100000:0.0:1789518156.048341:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffff2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:11315:x1876445616993152:12345-192.168.206.51@tcp:101:bash.0 Request processed in 5849us (6068us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518156.048349:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:1.0:1789518156.050467:0:7597:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff64ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7597:1876445627475968:192.168.206.51@tcp:105: 00010000:00010000:1.0:1789518156.050487:0:7597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518156.050534:0:7597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2343:x1876445616993280:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 2607us (2811us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518156.050543:0:7597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00100000:3.0:1789518156.050990:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518156.051061:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616993536 00000100:00100000:0.0:1789518156.051068:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616993536 00000100:00100000:0.0:1789518156.051119:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:0.0:1789518156.051129:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff69d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+18:11315:x1876445616993536:12345-192.168.206.51@tcp:35:bash.0 00000100:00100000:0.0:1789518156.051685:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff69d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+19:11315:x1876445616993536:12345-192.168.206.51@tcp:35:bash.0 Request processed in 555us (695us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1789518156.051693:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:2.0:1789518156.118578:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518156.118815:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616993792 00000100:00100000:3.0:1789518156.118827:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616993792 00000100:00100000:3.0:1789518156.118888:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 143 00000100:00100000:3.0:1789518156.118897:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+19:11325:x1876445616993792:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518156.118931:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518156.118950:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781634 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc920 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518156.119035:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789518156.119156:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781634 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc920 expref: 21 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.119182:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2ad3f00) 00010000:00010000:3.0:1789518156.119185:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789518156.119191:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781634 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc920 expref: 21 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.119204:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16600, rc 0) 00000100:00100000:3.0:1789518156.119377:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+20:11325:x1876445616993792:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 481us (807us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1789518156.119438:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 143 00000100:00100000:2.0:1789518156.125318:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518156.125410:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616994048 00000100:00100000:1.0:1789518156.125419:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616994048 00000100:00100000:1.0:1789518156.125483:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00100000:1.0:1789518156.125492:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+20:11325:x1876445616994048:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1789518156.126274:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+21:11325:x1876445616994048:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 781us (963us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1789518156.126283:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00100000:0.0:1789518156.174051:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518156.174167:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616994176 00000100:00100000:2.0:1789518156.174177:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616994176 00000100:00100000:2.0:1789518156.174234:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 144 00000100:00100000:2.0:1789518156.174243:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffffd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+21:11331:x1876445616994176:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518156.174264:0:8051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518156.174284:0:8051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c781642 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc927 expref: -99 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.174345:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c781649 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.174359:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c781649 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.174369:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c781649 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518156.174402:0:8051:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789518156.174406:0:8051:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518156.174422:0:8051:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c781649 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.174446:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c781642 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc927 expref: 23 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.174463:0:8051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c781649 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc927 expref: 22 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.174488:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99ffc2fdc600) 00010000:00010000:2.0:1789518156.174491:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518156.174495:0:8051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697000, rc 0) 00000100:00100000:2.0:1789518156.174561:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffffd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+22:11331:x1876445616994176:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 318us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518156.174567:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 144 00000100:00100000:2.0:1789518156.179418:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518156.179577:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616994432 00000100:00100000:1.0:1789518156.179586:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616994432 00000100:00100000:1.0:1789518156.179763:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 145 00000100:00100000:1.0:1789518156.179774:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+22:11331:x1876445616994432:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518156.179793:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518156.179811:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c781650 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc92e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.179915:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c781657 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.179937:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c781657 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.179948:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c781657 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518156.179960:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789518156.180078:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c781650 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc92e expref: 25 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.180094:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c781657 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc92e expref: 24 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.180101:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffd8781200) 00010000:00010000:1.0:1789518156.180115:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789518156.180119:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f7600, rc 0) 00000100:00100000:1.0:1789518156.180179:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+24:11331:x1876445616994432:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 407us (771us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1789518156.180186:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 145 00000100:00100000:0.0:1789518156.184133:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518156.184532:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616994560 00000100:00100000:2.0:1789518156.184543:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616994560 00000100:00100000:0.0:1789518156.184549:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518156.184654:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616994816 00000100:00100000:3.0:1789518156.184658:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616994816 00000100:00100000:3.0:1789518156.184698:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 146 00000100:00100000:3.0:1789518156.184708:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffffce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+25:11331:x1876445616994816:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518156.184727:0:8051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518156.184744:0:8051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781665 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc935 expref: -99 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.184836:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78166c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.184856:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78166c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.184867:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78166c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518156.184878:0:8051:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00000100:00100000:0.0:1789518156.184952:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:0.0:1789518156.184964:0:5798:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffffea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+27:2344:x1876445616994560:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518156.184975:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518156.184999:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c781657 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc92e expref: 27 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518156.185015:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffd8781200) 00010000:00010000:0.0:1789518156.185020:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518156.185027:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781665 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc935 expref: 27 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.185040:0:8051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78166c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc935 expref: 26 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.185045:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffd8781200) 00010000:00010000:3.0:1789518156.185047:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789518156.185049:0:8051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17200, rc 0) 00000100:00100000:0.0:1789518156.185193:0:5798:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffffea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+26:2344:x1876445616994560:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 232us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518156.185201:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:3.0:1789518156.186096:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffffce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+25:11331:x1876445616994816:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1387us (1544us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1789518156.186109:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 146 00000100:00100000:0.0:1789518156.190041:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518156.190089:0:6647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616994944 00000100:00100000:3.0:1789518156.190100:0:6647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616994944 00000100:00100000:3.0:1789518156.190146:0:6647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:3.0:1789518156.190154:0:6647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffffd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2342:x1876445616994944:12345-192.168.206.51@tcp:1:lfs.0 00010000:00010000:3.0:1789518156.190198:0:6647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c00b65d5/0x631fd8698c78167a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.190212:0:6647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e16297d1/0x631fd8698c78162d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc919 expref: 6 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.190217:0:6647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518156.190221:0:6647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789518156.190224:0:6647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c00b65d5/0x631fd8698c78167a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.190250:0:6647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e16297d1/0x631fd8698c78162d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc919 expref: 6 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.190270:0:6647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e16297d1/0x631fd8698c78162d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc919 expref: 6 pid: 6648 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518156.190281:0:6647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff69e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6647:1876445627476096:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518156.190354:0:6647:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc514a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518156.192395:0:6647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff69e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6647:1876445627476096:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518156.192420:0:6647:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c00b65d5/0x631fd8698c78167a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518156.192577:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518156.192639:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616995072 00000100:00100000:2.0:1789518156.192646:0:6653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616995072 00002000:00100000:2.0:1789518156.192686:0:6653:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff99fff78a9880 x1876445616995072/t0(0) o4->cfa1c47d-1425-4fe5-be2a-28ad5152a12d@192.168.206.51@tcp:557/0 lens 504/0 e 0 to 0 dl 1789518167 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518156.192696:0:6653:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff78a9880 with x1876445616995072 ext(0->12) 00010000:00010000:2.0:1789518156.192703:0:6653:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e16297d1/0x631fd8698c78162d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc919 expref: 7 pid: 6648 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.192716:0:6653:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e16297d1/0x631fd8698c78162d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc919 expref: 7 pid: 6648 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518156.192724:0:6653:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99fff78a9880 00000100:00100000:2.0:1789518156.192756:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:2.0:1789518156.192766:0:6653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:2343:x1876445616995072:12345-192.168.206.51@tcp:4:lfs.0 00000100:00100000:2.0:1789518156.193318:0:6653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+9:2343:x1876445616995072:12345-192.168.206.51@tcp:4:lfs.0 Request processed in 551us (740us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789518156.193334:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2 00002000:00100000:2.0:1789518156.193342:0:6653:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff99fff78a9880 x1876445616995072/t4294967305(0) o4->cfa1c47d-1425-4fe5-be2a-28ad5152a12d@192.168.206.51@tcp:557/0 lens 504/448 e 0 to 0 dl 1789518167 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518156.193350:0:6653:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff78a9880 with x1876445616995072 ext(0->12) 00010000:00010000:2.0:1789518156.193355:0:6653:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e16297d1/0x631fd8698c78162d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc919 expref: 9 pid: 6648 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.193366:0:6653:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e16297d1/0x631fd8698c78162d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc919 expref: 9 pid: 6648 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518156.193373:0:6653:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99fff78a9880 00000100:00100000:2.0:1789518156.194828:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518156.194930:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616995200 00000100:00100000:0.0:1789518156.194937:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616995200 00010000:00010000:0.0:1789518156.194966:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e16297d1/0x631fd8698c78162d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc919 expref: 9 pid: 6648 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518156.195004:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 64 00000100:00100000:0.0:1789518156.195012:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+9:2344:x1876445616995200:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518156.195024:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789518156.195039:0:5799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789518156.195043:0:5799:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789518156 00002000:00010000:0.0:1789518156.195045:0:5799:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789518156 00002000:00010000:0.0:1789518156.195047:0:5799:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789518156 00010000:00010000:0.0:1789518156.195052:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e16297d1/0x631fd8698c78162d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc919 expref: 9 pid: 6648 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518156.195064:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e16297d1/0x631fd8698c78162d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc919 expref: 9 pid: 6648 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518156.195157:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e16297d1/0x631fd8698c78162d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc919 expref: 9 pid: 6648 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518156.195171:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518156.195174:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518156.195178:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c00b65d5/0x631fd8698c78167a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518156.195184:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c00b65d5/0x631fd8698c78167a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518156.195259:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518156.195309:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+8:2344:x1876445616995200:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 297us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518156.195316:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 64 00010000:00010000:3.0:1789518156.195581:0:6647:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c00b65d5/0x631fd8698c78167a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.195591:0:6647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c00b65d5/0x631fd8698c78167a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.195785:0:6647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c00b65d5/0x631fd8698c78167a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.195795:0:6647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c00b65d5/0x631fd8698c78167a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.195803:0:6647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c00b65d5/0x631fd8698c78167a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.195822:0:6647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518156.195826:0:6647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c00b65d5/0x631fd8698c78167a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.195880:0:6647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c00b65d5/0x631fd8698c78167a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.195894:0:6647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c00b65d5/0x631fd8698c78167a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.195912:0:6647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c00b65d5/0x631fd8698c78167a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518156.196003:0:6647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffffd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:2342:x1876445616994944:12345-192.168.206.51@tcp:1:lfs.0 Request processed in 5848us (5972us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518156.196011:0:6647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:2.0:1789518156.197597:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518156.197697:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616995456 00000100:00100000:0.0:1789518156.197706:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616995456 00000100:00100000:0.0:1789518156.197749:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:0.0:1789518156.197755:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfa72450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+25:11331:x1876445616995456:12345-192.168.206.51@tcp:35:lfs.0 00000004:00010000:0.0:1789518156.197808:0:5815:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78166c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc935 expref: 25 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789518156.198061:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1789518156.198105:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1789518156.198863:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1789518156.199340:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c781681 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518156.199362:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781618 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc90b expref: 29 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518156.199371:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c781681 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518156.199404:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781618 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc90b expref: 29 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518156.199418:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781618 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc90b expref: 29 pid: 5812 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518156.199445:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79ac700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5815:1876445627476224:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518156.199535:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a6be40 going to sleep for 11 seconds 00000100:00100000:3.0:1789518156.201674:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79ac700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5815:1876445627476224:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518156.201700:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c781681 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518156.202073:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518156.202170:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616995584 00000100:00100000:1.0:1789518156.202176:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616995584 00010000:00010000:1.0:1789518156.202212:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781618 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc90b expref: 30 pid: 5812 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518156.202249:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 65 00000100:00100000:1.0:1789518156.202258:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+30:2343:x1876445616995584:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518156.202271:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518156.202277:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781618 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc90b expref: 30 pid: 5812 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.202288:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781618 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc90b expref: 30 pid: 5812 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.202307:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781618 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc90b expref: 30 pid: 5812 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.202321:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffd8781200) 00010000:00010000:1.0:1789518156.202326:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c781681 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.202333:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c781681 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.202353:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c781681 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.202378:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518156.202395:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c781681 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.202402:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c781681 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518156.202427:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+29:2343:x1876445616995584:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 170us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518156.202433:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 65 00000001:00080000:2.0:1789518156.202867:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1789518156.203067:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1789518156.203166:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1876445627476352:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789518156.203222:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518156.203286:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff4924a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789518156.203411:0:12017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627476352 00000100:00100000:3.0:1789518156.203416:0:12017:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627476352 00000100:00100000:3.0:1789518156.203521:0:12017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789518156.203528:0:12017:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5815:x1876445627476352:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789518156.203657:0:12017:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5815:x1876445627476352:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 130us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518156.203662:0:12017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1789518156.203824:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518156.203920:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffc5f1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1876445627476352:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789518156.204327:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1789518156.204367:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1876445627476480:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789518156.204389:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518156.204407:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff4924000 going to sleep for 11 seconds 00000100:00100000:3.0:1789518156.204422:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627476480 00000100:00100000:3.0:1789518156.204426:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627476480 00000100:00100000:3.0:1789518156.204456:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789518156.204463:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5815:x1876445627476480:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789518156.204599:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5815:x1876445627476480:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 135us (207us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789518156.204605:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789518156.204639:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffc5f1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1876445627476480:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789518156.204723:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1789518156.204752:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c781681 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.204760:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c781681 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.204769:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c781681 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.204775:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518156.204779:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c781681 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.204785:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c781681 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.204795:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffd8781200) 00010000:00010000:2.0:1789518156.204797:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789518156.204800:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c781681 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.204804:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c781681 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789518156.204969:0:5815:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789518156.205050:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1789518156.205060:0:5815:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 210201446146ns, next at 211201444210ns, rc = 0 00000001:00080000:2.0:1789518156.205066:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1789518156.205093:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffd8781200) 00010000:00010000:2.0:1789518156.205097:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789518156.205108:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78166c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc935 expref: 33 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518156.205290:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfa72450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+32:11331:x1876445616995456:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 7533us (7696us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1789518156.205302:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 38 00000020:00080000:2.0:1789518156.205306:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789518156.206746:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518156.206831:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616995712 00000100:00100000:3.0:1789518156.206838:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616995712 00000100:00100000:1.0:1789518156.206895:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 147 00000100:00100000:1.0:1789518156.206918:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffff28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+32:11331:x1876445616995712:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518156.206936:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518156.206953:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c781688 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc93c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.207008:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c781688 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc93c expref: 33 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.207023:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c781688 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc93c expref: 33 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.207190:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:1.0:1789518156.207193:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789518156.207197:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f6e00, rc 0) 00000100:00100000:1.0:1789518156.207247:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffff28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+33:11331:x1876445616995712:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 343us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518156.207255:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 147 00000100:00100000:0.0:1789518156.209260:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518156.209340:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616995968 00000100:00100000:1.0:1789518156.209360:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616995968 00000100:00100000:1.0:1789518156.209413:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 39 00000100:00100000:1.0:1789518156.209422:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+33:11331:x1876445616995968:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1789518156.210400:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+34:11331:x1876445616995968:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 398us (566us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1789518156.210415:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 39 00010000:00010000:3.0:1789518156.210990:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518156.250584:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518156.250744:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616996224 00000100:00100000:1.0:1789518156.250754:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616996224 00000100:00100000:1.0:1789518156.250921:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 148 00000100:00100000:1.0:1789518156.250932:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffffffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+34:11341:x1876445616996224:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518156.250954:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518156.250972:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c78168f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc943 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518156.251071:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789518156.251195:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c78168f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc943 expref: 36 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.251208:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2ad3f00) 00010000:00010000:1.0:1789518156.251211:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789518156.251215:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c78168f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc943 expref: 36 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.251227:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f7200, rc 0) 00000100:00100000:1.0:1789518156.251285:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffffffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+35:11341:x1876445616996224:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 355us (710us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1789518156.251292:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 148 00000100:00100000:2.0:1789518156.253161:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518156.253232:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616996352 00000100:00100000:3.0:1789518156.253241:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616996352 00000100:00100000:3.0:1789518156.253289:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 149 00000100:00100000:3.0:1789518156.253298:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+35:11341:x1876445616996352:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:3.0:1789518156.253354:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c78169d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.253370:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c78169d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.253397:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c78169d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.253415:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7816a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.253422:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7816a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.253428:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7816a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.253513:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7816ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.253523:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7816ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.253530:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7816ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518156.253565:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7816ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.253577:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c78169d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.253584:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c78169d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.253591:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c78169d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.253608:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518156.253694:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c78169d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.253703:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c78169d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.253713:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99ffc2fdc600) 00010000:00010000:3.0:1789518156.253716:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518156.253720:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c78169d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.253725:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c78169d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.253735:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7816a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.253741:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7816a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.253746:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7816a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.253751:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518156.253754:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7816a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.253759:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7816a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.253778:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99ffd8781e00) 00010000:00010000:3.0:1789518156.253780:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518156.253783:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7816a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.253789:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7816a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.253805:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7816ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.253812:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7816ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.253818:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7816ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.253824:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518156.253827:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7816ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.253833:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7816ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.253840:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:3.0:1789518156.253843:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518156.253846:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7816ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.253852:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7816ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518156.254033:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+35:11341:x1876445616996352:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 734us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518156.254041:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 149 00000100:00100000:0.0:1789518156.257488:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518156.257573:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616996608 00000100:00100000:2.0:1789518156.257581:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616996608 00000100:00100000:2.0:1789518156.257790:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 40 00000100:00100000:2.0:1789518156.257801:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+35:11341:x1876445616996608:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:2.0:1789518156.258015:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+36:11341:x1876445616996608:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 215us (533us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1789518156.258023:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 40 00000100:00100000:2.0:1789518156.295840:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518156.296179:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616996864 00000100:00100000:3.0:1789518156.296189:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616996864 00000100:00100000:3.0:1789518156.296247:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 150 00000100:00100000:3.0:1789518156.296256:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+36:11344:x1876445616996864:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518156.296276:0:8051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518156.296294:0:8051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7816b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc94a expref: -99 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.296360:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7816b9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.296375:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7816b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.296385:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7816b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.296399:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7816c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.296406:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7816c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.296413:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7816c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.298006:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7816c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.298022:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7816c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.298032:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7816c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518156.298045:0:8051:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789518156.298139:0:8051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7816b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.298155:0:8051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7816b9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.298161:0:8051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7816b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.298167:0:8051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518156.298171:0:8051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7816b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.298178:0:8051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7816b9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.298190:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99ffc2fdc600) 00010000:00010000:2.0:1789518156.298193:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518156.298197:0:8051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7816b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.298203:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7816b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.298216:0:8051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7816c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.298222:0:8051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7816c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.298228:0:8051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7816c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.298233:0:8051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518156.298242:0:8051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7816c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.298249:0:8051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7816c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.298257:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99ffd8781e00) 00010000:00010000:2.0:1789518156.298259:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518156.298262:0:8051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7816c0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.298267:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7816c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.298312:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7816b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc94a expref: 39 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.298325:0:8051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7816c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc94a expref: 38 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.298332:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:2.0:1789518156.298334:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518156.298336:0:8051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696600, rc 0) 00000100:00100000:2.0:1789518156.298408:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+38:11344:x1876445616996864:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 2152us (2575us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1789518156.298416:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 150 00000100:00100000:0.0:1789518156.303229:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518156.303327:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616996992 00000100:00100000:1.0:1789518156.303337:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616996992 00000100:00100000:1.0:1789518156.303433:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 151 00000100:00100000:1.0:1789518156.303444:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+38:11344:x1876445616996992:12345-192.168.206.51@tcp:54:lfs.0 00010000:00010000:1.0:1789518156.303518:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7816d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.303533:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7816d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.303545:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7816d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.303571:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7816d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.303578:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7816d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.303585:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7816d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.303590:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518156.303595:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7816d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.303602:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7816d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.303654:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:1.0:1789518156.303658:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789518156.303663:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7816d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.303683:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7816d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518156.303750:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+38:11344:x1876445616996992:12345-192.168.206.51@tcp:54:lfs.0 Request processed in 308us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518156.303757:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 151 00000100:00100000:0.0:1789518156.307584:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518156.307688:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616997248 00000100:00100000:1.0:1789518156.307697:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616997248 00000100:00100000:1.0:1789518156.307750:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:1.0:1789518156.307759:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+38:11344:x1876445616997248:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1789518156.308432:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+39:11344:x1876445616997248:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 673us (854us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1789518156.308442:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:2.0:1789518156.473813:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518156.473930:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616997504 00000100:00100000:1.0:1789518156.473939:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616997504 00000100:00100000:1.0:1789518156.473994:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 152 00000100:00100000:1.0:1789518156.474003:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+39:11375:x1876445616997504:12345-192.168.206.51@tcp:101:cat.0 00010000:00010000:1.0:1789518156.474025:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518156.474046:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7816dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc951 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.474131:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c7816e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.474145:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c7816e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.474172:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c7816e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518156.474183:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789518156.474310:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7816dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc951 expref: 42 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.474326:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c7816e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc951 expref: 41 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.474333:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:1.0:1789518156.474336:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789518156.474340:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f7000, rc 0) 00000100:00100000:1.0:1789518156.474399:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+41:11375:x1876445616997504:12345-192.168.206.51@tcp:101:cat.0 Request processed in 397us (594us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1789518156.474406:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 152 00000100:00100000:0.0:1789518156.476852:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518156.476919:0:7597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616997632 00000100:00100000:1.0:1789518156.476926:0:7597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616997632 00000100:00100000:2.0:1789518156.477197:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518156.477392:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616997888 00000100:00100000:3.0:1789518156.477397:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616997888 00000100:00100000:3.0:1789518156.477477:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:3.0:1789518156.477504:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc556a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+42:11375:x1876445616997888:12345-192.168.206.51@tcp:35:cat.0 00000100:00100000:3.0:1789518156.477764:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc556a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+43:11375:x1876445616997888:12345-192.168.206.51@tcp:35:cat.0 Request processed in 279us (567us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1789518156.477772:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:1.0:1789518156.478066:0:7597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:1.0:1789518156.478093:0:7597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd8065850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+42:2345:x1876445616997632:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518156.478104:0:7597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518156.478124:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c7816e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc951 expref: 42 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.478139:0:7597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:1.0:1789518156.478144:0:7597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518156.478177:0:7597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd8065850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+41:2345:x1876445616997632:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 103us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518156.478184:0:7597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:0.0:1789518156.523546:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518156.523647:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616998144 00000100:00100000:3.0:1789518156.523657:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616998144 00000100:00100000:3.0:1789518156.523713:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 153 00000100:00100000:3.0:1789518156.523724:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+41:11381:x1876445616998144:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:3.0:1789518156.523757:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518156.523761:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789518156.523786:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c781649 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc927 expref: 41 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.523804:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99ffc2fdc600) 00010000:00010000:3.0:1789518156.523809:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518156.523822:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7816f1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc958 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.523919:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7816f8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.523934:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7816c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc94a expref: 41 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.523958:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7816f8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.523989:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7816c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc94a expref: 41 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.524002:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7816c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc94a expref: 41 pid: 8051 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518156.524016:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff69e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1876445627476608:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518156.524118:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc514ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789518156.526948:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518156.527181:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff69e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1876445627476608:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518156.527218:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7816f8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518156.527507:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616998272 00000100:00100000:2.0:1789518156.527518:0:5798:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616998272 00010000:00010000:2.0:1789518156.527565:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7816c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc94a expref: 42 pid: 8051 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518156.527606:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 66 00000100:00100000:2.0:1789518156.527645:0:5798:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+42:2342:x1876445616998272:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518156.527658:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518156.527664:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7816c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc94a expref: 42 pid: 8051 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.527676:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7816c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc94a expref: 42 pid: 8051 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.527693:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7816c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc94a expref: 42 pid: 8051 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.527706:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:2.0:1789518156.527711:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7816f8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.527719:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7816f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.527726:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7816f8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.527756:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518156.527924:0:5798:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+41:2342:x1876445616998272:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 308us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518156.527932:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 66 00010000:00010000:3.0:1789518156.527996:0:5813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7816f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.528004:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7816f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518156.528020:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789518156.528166:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7816f1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc958 expref: 42 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.528179:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7816f8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc958 expref: 41 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.528197:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:3.0:1789518156.528200:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789518156.528202:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17800, rc 0) 00000100:00100000:3.0:1789518156.528224:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+41:11381:x1876445616998144:12345-192.168.206.51@tcp:101:dd.0 Request processed in 4504us (4688us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1789518156.528231:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 153 00000100:00100000:2.0:1789518156.533934:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518156.534092:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616998528 00000100:00100000:1.0:1789518156.534101:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616998528 00000100:00100000:1.0:1789518156.534187:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 154 00000100:00100000:1.0:1789518156.534198:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+41:11381:x1876445616998528:12345-192.168.206.51@tcp:36:dd.0 00010000:00010000:1.0:1789518156.534436:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c781706 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.534453:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c781706 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.534465:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c781706 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789518156.534510:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1789518156.534532:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e59ab063 reply state 000000000378c7a9 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c781706 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518156.534541:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789518156.534750:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+44:11381:x1876445616998528:12345-192.168.206.51@tcp:36:dd.0 Request processed in 553us (823us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1789518156.534757:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 154 00000020:00080000:1.0:1789518156.534762:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789518156.536567:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c781706 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.536580:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c781706 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.536588:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c781706 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.536594:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518156.536599:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c781706 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.536607:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c781706 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.536718:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:3.0:1789518156.536722:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518156.536727:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c781706 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.536734:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c781706 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518156.715409:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518156.715523:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616998656 00000100:00100000:1.0:1789518156.715532:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616998656 00000100:00100000:1.0:1789518156.715635:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 155 00000100:00100000:1.0:1789518156.715645:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc556b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+43:11395:x1876445616998656:12345-192.168.206.51@tcp:101:stat.0 00010000:00010000:1.0:1789518156.715665:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518156.715706:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c78170d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc95f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.715763:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c781714 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.715778:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c781714 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.715788:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c781714 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.715799:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c78171b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.715806:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c78171b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.715812:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c78171b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.715880:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781722 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.715888:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7816f8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc958 expref: 44 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.715893:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781722 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.715938:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7816f8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc958 expref: 44 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.715963:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7816f8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc958 expref: 44 pid: 5813 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518156.715978:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff64ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1876445627476736:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518156.716060:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee58e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518156.719583:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff64ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1876445627476736:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518156.719610:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781722 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518156.720032:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518156.720153:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616998912 00000100:00100000:3.0:1789518156.720160:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616998912 00000100:00100000:3.0:1789518156.720249:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 43 00000100:00100000:3.0:1789518156.720259:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+45:5576:x1876445616998912:12345-192.168.206.51@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789518156.720576:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+46:5576:x1876445616998912:12345-192.168.206.51@tcp:35:ldlm_bl.0 Request processed in 317us (544us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1789518156.720584:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 43 00000100:00100000:0.0:1789518156.722294:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518156.722673:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616999040 00000100:00100000:2.0:1789518156.722681:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616999040 00010000:00010000:2.0:1789518156.722712:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7816f8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc958 expref: 46 pid: 5813 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518156.722751:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 67 00000100:00100000:2.0:1789518156.722760:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+46:2343:x1876445616999040:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518156.722774:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518156.722780:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7816f8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc958 expref: 46 pid: 5813 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.722793:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7816f8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc958 expref: 46 pid: 5813 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.722812:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7816f8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc958 expref: 46 pid: 5813 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.722836:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:2.0:1789518156.722841:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781722 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.722850:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.722859:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781722 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.722911:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518156.722938:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518156.722948:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518156.722962:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+45:2343:x1876445616999040:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 200us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518156.722971:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 67 00000004:00200000:0.0:1789518156.722995:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789518156.723001:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518156.723023:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518156.723035:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518156.723044:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c781714 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518156.723051:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c781714 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518156.723058:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c781714 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518156.723064:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f6400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518156.723068:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c781714 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518156.723076:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c781714 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518156.723098:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99ffc2fdc600) 00010000:00010000:0.0:1789518156.723101:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518156.723106:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c781714 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518156.723112:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c781714 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518156.723133:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c78171b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518156.723140:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c78171b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518156.723146:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c78171b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518156.723151:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518156.723154:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c78171b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518156.723161:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c78171b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518156.723170:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99ffc2fdc900) 00010000:00010000:0.0:1789518156.723172:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518156.723175:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c78171b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518156.723181:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c78171b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518156.723216:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c78170d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc95f expref: 45 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518156.723233:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781722 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc95f expref: 44 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518156.723251:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:0.0:1789518156.723254:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518156.723256:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f6800, rc 0) 00000100:00100000:0.0:1789518156.723295:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc556b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+44:11395:x1876445616998656:12345-192.168.206.51@tcp:101:stat.0 Request processed in 7651us (7894us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518156.723302:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 155 00000100:00100000:0.0:1789518156.772039:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518156.772132:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616999296 00000100:00100000:2.0:1789518156.772141:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616999296 00000100:00100000:2.0:1789518156.772262:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 156 00000100:00100000:2.0:1789518156.772273:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+44:11401:x1876445616999296:12345-192.168.206.51@tcp:36:truncate.0 00010000:00010000:2.0:1789518156.772329:0:8051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518156.772355:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781722 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc95f expref: 44 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.772373:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:2.0:1789518156.772378:0:8051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518156.772576:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781729 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.772590:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781729 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518156.772600:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781729 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789518156.772751:0:8051:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1789518156.772775:0:8051:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f18ba9ca reply state 000000006fcfdb72 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781729 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518156.772784:0:8051:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518156.773078:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+46:11401:x1876445616999296:12345-192.168.206.51@tcp:36:truncate.0 Request processed in 806us (1047us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1789518156.773085:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 156 00000020:00080000:2.0:1789518156.773090:0:8051:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789518156.774739:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781729 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.774754:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781729 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.774761:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781729 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.774768:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518156.774772:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781729 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.774780:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781729 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.774793:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:1.0:1789518156.774796:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518156.774800:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781729 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.774818:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781729 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518156.895244:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518156.895366:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616999424 00000100:00100000:3.0:1789518156.895376:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616999424 00000100:00100000:3.0:1789518156.895420:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 157 00000100:00100000:3.0:1789518156.895430:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+45:11415:x1876445616999424:12345-192.168.206.51@tcp:101:stat.0 00010000:00010000:3.0:1789518156.895451:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518156.895482:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c781730 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc966 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.895542:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781737 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.895556:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781737 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.895567:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781737 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.895580:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78173e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.895588:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78173e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.895607:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78173e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.895717:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781745 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.895726:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781745 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.895733:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781745 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518156.895767:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1789518156.895771:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518156.895790:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781745 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.895802:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781745 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.895809:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781737 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.895815:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781737 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.895992:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781737 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.895998:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518156.896002:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781737 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.896016:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781737 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.896027:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99ffc2fdc600) 00010000:00010000:3.0:1789518156.896030:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518156.896035:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781737 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.896041:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781737 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.896054:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78173e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.896060:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78173e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.896066:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78173e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.896071:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518156.896074:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78173e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.896080:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78173e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.896086:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99ffd8781000) 00010000:00010000:3.0:1789518156.896089:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518156.896092:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78173e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.896140:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78173e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.896171:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c781730 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc966 expref: 47 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.896183:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781745 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc966 expref: 46 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518156.896190:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:3.0:1789518156.896193:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518156.896195:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16800, rc 0) 00000100:00100000:3.0:1789518156.896252:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+46:11415:x1876445616999424:12345-192.168.206.51@tcp:101:stat.0 Request processed in 824us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518156.896257:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 157 00000100:00100000:2.0:1789518156.958865:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518156.958958:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616999680 00000100:00100000:1.0:1789518156.958967:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616999680 00000100:00100000:1.0:1789518156.959027:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 158 00000100:00100000:1.0:1789518156.959036:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+46:11425:x1876445616999680:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518156.959055:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518156.959076:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c78174c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc96d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518156.959163:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789518156.959275:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c78174c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc96d expref: 48 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.959288:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2ad3f00) 00010000:00010000:1.0:1789518156.959290:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789518156.959295:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c78174c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc96d expref: 48 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518156.959309:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f6000, rc 0) 00000100:00100000:1.0:1789518156.959374:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+47:11425:x1876445616999680:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 338us (517us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1789518156.959382:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 158 00000100:00100000:2.0:1789518156.963046:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518156.963103:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445616999936 00000100:00100000:1.0:1789518156.963113:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445616999936 00000100:00100000:1.0:1789518156.963166:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:1.0:1789518156.963189:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfa71450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+47:11425:x1876445616999936:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1789518156.963402:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfa71450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+48:11425:x1876445616999936:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 215us (369us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1789518156.963410:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:0.0:1789518157.004302:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518157.004435:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617000192 00000100:00100000:1.0:1789518157.004445:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617000192 00000100:00100000:1.0:1789518157.004538:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 159 00000100:00100000:1.0:1789518157.004549:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+48:11431:x1876445617000192:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:1.0:1789518157.004571:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518157.004595:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c78175a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc974 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.004713:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c781761 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.004728:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781745 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc966 expref: 49 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.004737:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c781761 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.004769:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781745 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc966 expref: 49 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.004781:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781745 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc966 expref: 49 pid: 5813 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518157.004793:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff64ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1876445627476864:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518157.004893:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee58ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1789518157.008655:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518157.008750:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617000320 00000100:00100000:3.0:1789518157.008763:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617000320 00010000:00010000:3.0:1789518157.008806:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781745 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc966 expref: 50 pid: 5813 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518157.008845:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 68 00000100:00100000:3.0:1789518157.008855:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+50:2342:x1876445617000320:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518157.008868:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518157.008874:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781745 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc966 expref: 50 pid: 5813 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518157.008917:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781745 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc966 expref: 50 pid: 5813 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518157.008939:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:3.0:1789518157.008944:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c781761 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518157.008953:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c781761 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518157.008961:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c781761 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518157.009040:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518157.009094:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+50:2342:x1876445617000320:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 240us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518157.009101:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 68 00010000:00010000:1.0:1789518157.009389:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781745 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc966 expref: 49 pid: 5813 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518157.009406:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff64ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1876445627476864:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518157.009424:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c781761 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.009432:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c781761 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.009438:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c781761 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518157.009454:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1789518157.009589:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c78175a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc974 expref: 50 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.009605:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c781761 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc974 expref: 49 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.009648:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:1.0:1789518157.009652:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789518157.009655:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f6600, rc 0) 00000100:00100000:1.0:1789518157.009696:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+49:11431:x1876445617000192:12345-192.168.206.51@tcp:101:bash.0 Request processed in 5149us (5402us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1789518157.009703:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 159 00000100:00100000:2.0:1789518157.014374:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518157.014501:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617000576 00000100:00100000:0.0:1789518157.014510:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617000576 00000100:00100000:0.0:1789518157.014607:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 160 00000100:00100000:0.0:1789518157.014637:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+49:11431:x1876445617000576:12345-192.168.206.51@tcp:36:bash.0 00010000:00010000:0.0:1789518157.014859:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78176f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518157.014871:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78176f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518157.014880:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78176f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789518157.014936:0:8051:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1789518157.014959:0:8051:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000029a4464a reply state 00000000a4fdca69 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78176f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518157.014968:0:8051:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518157.015069:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+52:11431:x1876445617000576:12345-192.168.206.51@tcp:36:bash.0 Request processed in 435us (702us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1789518157.015076:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 160 00000020:00080000:0.0:1789518157.015081:0:8051:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789518157.020478:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78176f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518157.020496:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78176f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518157.020504:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78176f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518157.020510:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bce00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518157.020514:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78176f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518157.020554:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78176f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518157.020570:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:3.0:1789518157.020572:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518157.020577:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78176f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518157.020583:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78176f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518157.022385:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518157.022841:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617000704 00000100:00100000:3.0:1789518157.022854:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617000704 00000100:00100000:3.0:1789518157.022934:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 161 00000100:00100000:3.0:1789518157.022946:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+51:11431:x1876445617000704:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:3.0:1789518157.023164:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518157.023192:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c781776 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc97b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518157.023304:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78177d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518157.023323:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c781761 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc974 expref: 52 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518157.023333:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78177d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518157.023374:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c781761 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc974 expref: 52 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518157.023407:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c781761 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc974 expref: 52 pid: 5811 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518157.023424:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff69e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1876445627476992:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518157.023605:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc514a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518157.039353:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518157.042032:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff69e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1876445627476992:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518157.043035:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617000832 00000100:00100000:2.0:1789518157.043047:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617000832 00010000:00010000:3.0:1789518157.043080:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78177d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518157.043095:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c781761 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc974 expref: 53 pid: 5811 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518157.043146:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 69 00000100:00100000:2.0:1789518157.043159:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed747800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+53:2343:x1876445617000832:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518157.043177:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518157.043186:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c781761 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc974 expref: 53 pid: 5811 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518157.043200:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c781761 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc974 expref: 53 pid: 5811 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518157.043229:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c781761 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc974 expref: 53 pid: 5811 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518157.043248:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:2.0:1789518157.043253:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78177d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518157.043281:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78177d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518157.043290:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78177d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518157.043324:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518157.043466:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed747800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+52:2343:x1876445617000832:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 308us (4127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518157.043474:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 69 00010000:00010000:3.0:1789518157.043581:0:5813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78177d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518157.043591:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78177d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518157.043673:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789518157.043679:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518157.043707:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78177d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518157.043805:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c781776 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc97b expref: 52 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518157.043870:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78177d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc97b expref: 51 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518157.043878:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:3.0:1789518157.043889:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518157.043892:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17200, rc 0) 00000100:00100000:3.0:1789518157.043944:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+51:11431:x1876445617000704:12345-192.168.206.51@tcp:101:bash.0 Request processed in 21000us (21571us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518157.043955:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 161 00000100:00100000:0.0:1789518157.048143:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518157.048455:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617001088 00000100:00100000:1.0:1789518157.048486:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617001088 00000100:00100000:1.0:1789518157.048558:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 45 00000100:00100000:1.0:1789518157.048570:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+51:11431:x1876445617001088:12345-192.168.206.51@tcp:35:bash.0 00000100:00100000:1.0:1789518157.048924:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+52:11431:x1876445617001088:12345-192.168.206.51@tcp:35:bash.0 Request processed in 354us (793us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1789518157.048933:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 45 00000100:00100000:2.0:1789518157.112023:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518157.112887:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617001344 00000100:00100000:1.0:1789518157.112914:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617001344 00000100:00100000:1.0:1789518157.112980:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 162 00000100:00100000:1.0:1789518157.112992:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+52:11441:x1876445617001344:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518157.113025:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518157.113159:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c781784 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc982 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518157.113384:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789518157.113578:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c781784 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc982 expref: 54 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.113594:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2ad3f00) 00010000:00010000:1.0:1789518157.113598:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789518157.113603:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c781784 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc982 expref: 54 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.113646:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f6000, rc 0) 00000100:00100000:1.0:1789518157.113831:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+53:11441:x1876445617001344:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 840us (1820us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1789518157.113839:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 162 00000100:00100000:0.0:1789518157.115966:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518157.116283:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617001472 00000100:00100000:1.0:1789518157.116295:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617001472 00000100:00100000:1.0:1789518157.116367:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 163 00000100:00100000:1.0:1789518157.116376:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc556a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+53:11441:x1876445617001472:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:1.0:1789518157.116454:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c781792 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.116470:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c781792 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.116480:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c781792 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.116492:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781799 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.116496:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.116500:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.116581:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7817a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.116586:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7817a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.116590:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7817a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789518157.116652:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7817a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.116678:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c781792 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.116682:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c781792 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.116702:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c781792 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.116706:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f6600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518157.116710:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c781792 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.116717:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c781792 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.116726:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99ffc2fdc600) 00010000:00010000:1.0:1789518157.116728:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518157.116732:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c781792 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.116736:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c781792 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.116746:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.116751:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781799 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.116754:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781799 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.116762:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f6800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518157.116764:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781799 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.116767:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781799 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.116771:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99ffc2fdc700) 00010000:00010000:1.0:1789518157.116772:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518157.116774:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781799 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.116777:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c781799 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.116788:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7817a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.116792:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7817a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.116795:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7817a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.116798:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518157.116799:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7817a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.116802:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7817a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.116813:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:1.0:1789518157.116814:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518157.116816:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7817a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.116819:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7817a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518157.116913:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc556a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+53:11441:x1876445617001472:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 537us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518157.116921:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 163 00000100:00100000:0.0:1789518157.119838:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518157.119915:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617001728 00000100:00100000:1.0:1789518157.119927:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617001728 00000100:00100000:1.0:1789518157.119994:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 46 00000100:00100000:1.0:1789518157.120014:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+53:11441:x1876445617001728:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1789518157.120349:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+54:11441:x1876445617001728:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 345us (523us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1789518157.120357:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 46 00000100:00100000:2.0:1789518157.141514:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518157.141653:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617001984 00000100:00100000:0.0:1789518157.141666:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617001984 00000100:00100000:0.0:1789518157.141739:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 164 00000100:00100000:0.0:1789518157.141752:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+54:11444:x1876445617001984:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518157.141784:0:8051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518157.141808:0:8051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c7817a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc989 expref: -99 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518157.141914:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c7817ae lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518157.141931:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c7817ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518157.141945:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c7817ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518157.141962:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c7817b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518157.141970:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c7817b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518157.142004:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c7817b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518157.142144:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7817bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518157.142152:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7817bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518157.142161:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7817bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518157.142171:0:8051:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789518157.142288:0:8051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c7817ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518157.142297:0:8051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c7817ae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518157.142304:0:8051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c7817ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518157.142311:0:8051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518157.142316:0:8051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c7817ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518157.142324:0:8051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c7817ae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518157.142335:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99ffc2fdc600) 00010000:00010000:0.0:1789518157.142337:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518157.142347:0:8051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c7817ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518157.142352:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c7817ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518157.142362:0:8051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c7817b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518157.142366:0:8051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c7817b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518157.142370:0:8051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c7817b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518157.142373:0:8051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518157.142375:0:8051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c7817b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518157.142378:0:8051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c7817b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518157.142381:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99ffd2a17a00) 00010000:00010000:0.0:1789518157.142383:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518157.142384:0:8051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c7817b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518157.142387:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c7817b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518157.142425:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c7817a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc989 expref: 57 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518157.142442:0:8051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7817bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc989 expref: 56 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518157.142447:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:0.0:1789518157.142449:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518157.142450:0:8051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd200, rc 0) 00000100:00100000:0.0:1789518157.142525:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+56:11444:x1876445617001984:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 776us (1024us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1789518157.142532:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 164 00000100:00100000:0.0:1789518157.145746:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518157.145808:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617002112 00000100:00100000:3.0:1789518157.145820:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617002112 00000100:00100000:0.0:1789518157.145853:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518157.145883:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:3.0:1789518157.145892:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+56:2345:x1876445617002112:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518157.145919:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518157.145944:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7817bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc989 expref: 56 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518157.145965:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:3.0:1789518157.145969:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518157.145984:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617002240 00000100:00100000:1.0:1789518157.145991:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617002240 00000100:00100000:3.0:1789518157.146070:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+56:2345:x1876445617002112:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 180us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518157.146079:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:1.0:1789518157.146080:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 165 00000100:00100000:1.0:1789518157.146094:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+55:11444:x1876445617002240:12345-192.168.206.51@tcp:54:lfs.0 00010000:00010000:1.0:1789518157.146161:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7817ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.146178:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7817ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.146212:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7817ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.146241:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7817ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.146249:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7817ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.146266:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7817ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.146280:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518157.146285:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7817ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.146292:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7817ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.146300:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:1.0:1789518157.146303:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789518157.146307:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7817ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.146312:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7817ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518157.146351:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+55:11444:x1876445617002240:12345-192.168.206.51@tcp:54:lfs.0 Request processed in 262us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518157.146359:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 165 00000100:00100000:2.0:1789518157.148124:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518157.148235:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617002496 00000100:00100000:3.0:1789518157.148376:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617002496 00000100:00100000:3.0:1789518157.148492:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:3.0:1789518157.148504:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+55:11444:x1876445617002496:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:3.0:1789518157.148816:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+56:11444:x1876445617002496:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 314us (701us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1789518157.148835:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 47 00010000:00010000:2.0:1789518157.235172:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518157.270124:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518157.270438:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617002752 00000100:00100000:1.0:1789518157.270466:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617002752 00000100:00100000:1.0:1789518157.270545:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 166 00000100:00100000:1.0:1789518157.270556:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+56:11462:x1876445617002752:12345-192.168.206.51@tcp:101:cat.0 00010000:00010000:1.0:1789518157.270588:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518157.270660:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7817d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc990 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.271435:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c7817d8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.271457:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c7817d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.271483:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c7817d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518157.271498:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789518157.272524:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7817d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc990 expref: 59 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.272552:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c7817d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc990 expref: 58 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.272562:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:1.0:1789518157.272565:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789518157.272569:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f6800, rc 0) 00000100:00100000:1.0:1789518157.274203:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+58:11462:x1876445617002752:12345-192.168.206.51@tcp:101:cat.0 Request processed in 3635us (4090us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1789518157.274216:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 166 00000100:00100000:0.0:1789518157.297764:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518157.302373:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617002880 00000100:00100000:1.0:1789518157.302394:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617002880 00000100:00100000:1.0:1789518157.302574:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 167 00000100:00100000:1.0:1789518157.302587:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+58:11463:x1876445617002880:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518157.302641:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518157.302667:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7817e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc997 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.302758:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c7817ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.302775:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c7817ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.302790:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c7817ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518157.302832:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789518157.302837:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518157.302857:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c7817ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.302888:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7817e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc997 expref: 60 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.302926:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c7817ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc997 expref: 59 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.302936:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99ffc2fdc600) 00010000:00010000:1.0:1789518157.302939:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518157.302970:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f6600, rc 0) 00000100:00100000:1.0:1789518157.303073:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+59:11463:x1876445617002880:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 488us (5322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518157.303085:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 167 00000100:00100000:2.0:1789518157.306658:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518157.307235:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617003264 00000100:00100000:1.0:1789518157.307378:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617003264 00000100:00100000:1.0:1789518157.307454:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:1.0:1789518157.307464:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+59:11463:x1876445617003264:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1789518157.307909:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+60:11463:x1876445617003264:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 434us (1250us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1789518157.307918:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:2.0:1789518157.311227:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518157.311502:0:7597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617003392 00000100:00100000:0.0:1789518157.311512:0:7597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617003392 00000100:00100000:0.0:1789518157.311599:0:7597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:0.0:1789518157.311611:0:7597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+60:11463:x1876445617003392:12345-192.168.206.51@tcp:103:lfs.0 00010000:00010000:0.0:1789518157.311649:0:7597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789518157.311680:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78177d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc97b expref: 60 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518157.311705:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c7817d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc990 expref: 59 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518157.311720:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6e00/0x631fd8698c781688 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc93c expref: 58 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518157.311754:0:7597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:0.0:1789518157.311768:0:7597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518157.311841:0:7597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+57:11463:x1876445617003392:12345-192.168.206.51@tcp:103:lfs.0 Request processed in 233us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518157.311850:0:7597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:0.0:1789518157.314211:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518157.314763:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617003520 00000100:00100000:2.0:1789518157.314776:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617003520 00000100:00100000:2.0:1789518157.314963:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 168 00000100:00100000:2.0:1789518157.314975:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+57:11463:x1876445617003520:12345-192.168.206.51@tcp:58:lfs.0 00010000:00010000:2.0:1789518157.315141:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7817f4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518157.315160:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7817f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518157.315173:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7817f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789518157.315423:0:8051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1789518157.315546:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+57:11463:x1876445617003520:12345-192.168.206.51@tcp:58:lfs.0 Request processed in 573us (1346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518157.315555:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 168 00000100:00100000:3.0:1789518157.329768:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518157.330075:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617003648 00000100:00100000:1.0:1789518157.330087:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617003648 00000100:00100000:1.0:1789518157.330268:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 169 00000100:00100000:1.0:1789518157.330281:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff69e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+57:11465:x1876445617003648:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518157.330307:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518157.330333:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7817fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc99e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.330412:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c781802 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.330429:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c781802 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.330442:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c781802 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.330473:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c781809 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.330489:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c781809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.330497:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c781809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.330600:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c781810 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.330609:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c781810 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.330658:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c781810 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518157.330700:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789518157.330705:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518157.330728:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c781810 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.330741:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c781810 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.330749:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c781802 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.330756:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c781802 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.330764:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c781802 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.330781:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f6000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518157.330786:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c781802 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.330796:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c781802 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.330810:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99ffc2fdc600) 00010000:00010000:1.0:1789518157.330825:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518157.330831:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c781802 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.330838:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c781802 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.330853:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c781809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.330859:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c781809 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.330865:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c781809 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.330871:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518157.330874:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c781809 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.330885:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c781809 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.330914:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99ffc2fdc700) 00010000:00010000:1.0:1789518157.330917:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518157.330920:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c781809 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.330926:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c781809 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.330962:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c7817fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc99e expref: 59 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.330977:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c781810 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc99e expref: 58 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518157.331104:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2ad3e00) 00010000:00010000:1.0:1789518157.331108:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518157.331112:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f6400, rc 0) 00000100:00100000:1.0:1789518157.331197:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff69e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+58:11465:x1876445617003648:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 918us (1439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518157.331205:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 169 00000100:00100000:0.0:1789518157.427044:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789518157.427077:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:824c8f07-28fa-48fd-81af-173b194570e6:3283:1876445627477248:0@lo:400:kworker.0 00000100:00100000:1.0:1789518157.427102:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627477504:0@lo:400:kworker.0 00000100:00100000:2.0:1789518157.427232:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627477376:0@lo:400:kworker.0 00000100:00100000:0.0:1789518157.427966:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518157.428029:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627477120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518157.428159:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518157.428195:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627477760:0@lo:400:kworker.0 00000100:00100000:1.0:1789518157.428196:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518157.428234:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518157.428257:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627477248 00000100:00100000:1.0:1789518157.428268:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627477248 00000100:00100000:0.0:1789518157.428268:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789518157.428281:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518157.428283:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627477632:0@lo:400:kworker.0 00000100:00100000:1.0:1789518157.428336:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789518157.428338:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627477888:0@lo:400:kworker.0 00000100:00100000:1.0:1789518157.428351:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+19:3283:x1876445627477248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518157.428352:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518157.428395:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518157.428413:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627477120 00000100:00100000:0.0:1789518157.428419:0:6652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627477120 00000100:00100000:1.0:1789518157.428441:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:824c8f07-28fa-48fd-81af-173b194570e6+19:3283:x1876445627477248:12345-0@lo:400:kworker.0 Request processed in 92us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518157.428460:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789518157.428503:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627477632 00000100:00100000:0.0:1789518157.428511:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789518157.428514:0:6649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627477632 00000100:00100000:1.0:1789518157.428520:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627477504 00000100:00100000:0.0:1789518157.428526:0:6652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffff2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627477120:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518157.428563:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627477888 00000100:00100000:2.0:1789518157.428568:0:6649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627477888 00002000:00000024:0.0:1789518157.428576:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789518157.428595:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789518157.428607:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3283:x1876445627477632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518157.428653:0:6652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffff2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1876445627477120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518157.428660:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789518157.428698:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789518157.428707:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627477888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518157.428922:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627477504 00000100:00100000:1.0:1789518157.428956:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627477760 00000100:00100000:1.0:1789518157.428960:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627477760 00000100:00100000:1.0:1789518157.428979:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627477376 00000100:00100000:1.0:1789518157.428982:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627477376 00000100:00100000:1.0:1789518157.429003:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789518157.429009:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627477888:12345-0@lo:400:kworker.0 Request processed in 300us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518157.429017:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff64ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627477504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518157.429022:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1789518157.429054:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789518157.429060:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518157.429102:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3283:x1876445627477632:12345-0@lo:400:kworker.0 Request processed in 496us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518157.429105:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff64ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627477504:12345-0@lo:400:kworker.0 Request processed in 91us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518157.429114:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627477632:0@lo:400:kworker.0 00000100:00100000:2.0:1789518157.429133:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789518157.429134:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789518157.429139:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:824c8f07-28fa-48fd-81af-173b194570e6:3283:1876445627477248:0@lo:400:kworker.0 00000100:00100000:0.0:1789518157.429160:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1789518157.429166:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fffffff100, transno 4294967310 00000004:00080000:0.0:1789518157.429182:0:3283:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1789518157.429188:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627477504:0@lo:400:kworker.0 00000100:00100000:2.0:1789518157.429200:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789518157.429221:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627477120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518157.429231:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627477760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518157.429285:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789518157.429306:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627477760:12345-0@lo:400:kworker.0 Request processed in 93us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518157.429317:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789518157.429322:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627477760:0@lo:400:kworker.0 00000100:00100000:0.0:1789518157.429355:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627477376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518157.429398:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627477888:0@lo:400:kworker.0 00000100:00100000:0.0:1789518157.429418:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627477376:12345-0@lo:400:kworker.0 Request processed in 119us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518157.429429:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789518157.429439:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627477376:0@lo:400:kworker.0 00000040:00080000:2.0:1789518157.916820:0:12455:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789518157.916829:0:12455:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518157.916874:0:12455:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1789518157.916879:0:12455:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1789518157.973771:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967453 is committed 00000020:00080000:2.0:1789518157.973800:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:2.0:1789518157.974523:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000004:00080000:2.0:1789518157.974575:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1789518157.974593:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99fff4924a80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1789518157.974599:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffd1089700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99fff4924600 00000020:00080000:2.0:1789518157.974602:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffd1089000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99fff7a13800 00000020:00080000:2.0:1789518157.974670:0:5844:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1789518157.974908:0:5844:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1789518157.975018:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627478016:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789518157.975089:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518157.975188:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627478016 00000100:00100000:2.0:1789518157.975197:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627478016 00000100:00100000:2.0:1789518157.975244:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789518157.975253:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627478016:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789518157.975278:0:6648:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:2.0:1789518157.975310:0:6648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa9e14c, atime: 0x6aa9e14c, ctime: 0x6aa9e14c, blocks: 0xb 00010000:00010000:2.0:1789518157.975319:0:6648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781817 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518157.975334:0:6648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=211s v=(0 0) 00010000:00010000:2.0:1789518157.975339:0:6648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518157.975353:0:6648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781817 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518157.975371:0:6648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781817 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518157.975381:0:6648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781817 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518157.975389:0:6648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781817 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518157.975406:0:6648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789518157.975966:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3281:x1876445627478016:12345-0@lo:6:osp-syn-0-0.0 Request processed in 713us (875us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789518157.975976:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:2.0:1789518157.976008:0:7595:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518157.976015:0:7595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781817 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518157.976024:0:7595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518157.976029:0:7595:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781817 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518157.976039:0:7595:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781817 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518157.976070:0:7595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781817 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518157.976078:0:7595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781817 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518157.976096:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518157.976099:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518157.976101:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789518157.976136:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fff7882a00/2, rc 0, transno 4294967307 00000100:00100000:2.0:1789518157.976143:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627478016:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1789518157.983488:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:2.0:1789518157.983517:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000040:00080000:0.0:1789518158.066827:0:11633:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789518158.066834:0:11633:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518158.066904:0:11633:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1789518158.066912:0:11633:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789518158.067041:0:11633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4978700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11633:1876445627478144:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789518158.067217:0:11633:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbb5000 going to sleep for 11 seconds 00000100:00100000:0.0:1789518158.071089:0:11633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4978700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11633:1876445627478144:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789518158.072210:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518158.072336:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617003776 00000100:00100000:2.0:1789518158.072348:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617003776 00000100:00100000:2.0:1789518158.072482:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 170 00000100:00100000:2.0:1789518158.072494:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+16:11477:x1876445617003776:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789518158.072533:0:5811:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789518158.072716:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+16:11477:x1876445617003776:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 224us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518158.072724:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 170 00000100:00080000:0.0:1789518158.072963:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518158.075700:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518158.075856:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617003904 00000100:00100000:0.0:1789518158.075868:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617003904 00000100:00100000:0.0:1789518158.075949:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 171 00000100:00100000:0.0:1789518158.075962:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff69c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+16:11477:x1876445617003904:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789518158.076070:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78181e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.076092:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78181e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.076108:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78181e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.076127:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781825 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.076135:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781825 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.076142:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781825 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.076176:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c78182c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.076186:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c78182c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.076194:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c78182c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518158.076260:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789518158.076265:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518158.076282:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c78182c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.076296:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78181e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.076303:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78181e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.076310:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78181e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.076317:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518158.076322:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78181e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.076331:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78181e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.076344:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffc2ad3d00) 00010000:00010000:0.0:1789518158.076348:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518158.076353:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78181e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.076360:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78181e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.076376:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781825 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.076393:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781825 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.076400:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781825 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.076405:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bde00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518158.076409:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781825 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.076415:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781825 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.076424:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff99ffd2a17a00) 00010000:00010000:0.0:1789518158.076427:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518158.076430:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781825 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.076437:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781825 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.076455:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c78182c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.076461:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c78182c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.076467:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c78182c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.076472:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518158.076482:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c78182c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.076489:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c78182c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.076497:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2ad3e00) 00010000:00010000:0.0:1789518158.076500:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518158.076503:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c78182c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.076509:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c78182c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518158.077084:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff69c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+16:11477:x1876445617003904:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 Request processed in 1121us (1391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518158.077095:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 171 00000100:00100000:1.0:1789518158.079069:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518158.079174:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617004160 00000100:00100000:2.0:1789518158.079185:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617004160 00000100:00100000:2.0:1789518158.079251:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 172 00000100:00100000:2.0:1789518158.079262:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff64ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+16:11477:x1876445617004160:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518158.079303:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518158.079326:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781833 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc9a5 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.079451:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c78183a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.079468:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c78183a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.079480:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c78183a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518158.079493:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789518158.079788:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c78183a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.079797:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c78183a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.079805:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c78183a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.079824:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518158.079829:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c78183a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.079837:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c78183a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.079851:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2ad3e00) 00010000:00010000:2.0:1789518158.079863:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518158.079869:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c78183a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.079875:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c78183a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.079934:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781833 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9a5 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.079946:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffc2ad3d00) 00010000:00010000:2.0:1789518158.079948:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789518158.079952:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781833 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9a5 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.079963:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697600, rc 0) 00000100:00100000:2.0:1789518158.080042:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff64ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+17:11477:x1876445617004160:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 782us (985us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1789518158.080052:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 172 00000100:00100000:2.0:1789518158.083634:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518158.084409:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617004288 00000100:00100000:0.0:1789518158.084425:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617004288 00000100:00100000:0.0:1789518158.084560:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 173 00000100:00100000:0.0:1789518158.084571:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+17:11477:x1876445617004288:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789518158.084605:0:5812:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789518158.084749:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+17:11477:x1876445617004288:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 179us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518158.084758:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 173 00000100:00100000:0.0:1789518158.087883:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518158.088540:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617004544 00000100:00100000:2.0:1789518158.088553:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617004544 00000100:00100000:2.0:1789518158.088757:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 174 00000100:00100000:2.0:1789518158.088771:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff497b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+17:11477:x1876445617004544:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518158.088800:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518158.088804:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789518158.088943:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c7817ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc997 expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.089036:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99ffc2fdc600) 00010000:00010000:2.0:1789518158.089044:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518158.089062:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c781848 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc9ac expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789518158.090533:0:5811:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1789518158.091305:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c78184f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.091325:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c78184f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.091337:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c78184f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.091413:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c781848 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9ac expref: 19 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.091435:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c78184f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9ac expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.091476:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99ffc2ad3300) 00010000:00010000:2.0:1789518158.091481:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518158.091485:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697600, rc 0) 00000100:00100000:2.0:1789518158.091778:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff497b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+18:11477:x1876445617004544:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 3001us (3897us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1789518158.091790:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 174 00000100:00100000:3.0:1789518158.096162:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518158.097146:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617004800 00000100:00100000:1.0:1789518158.097268:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617004800 00000100:00100000:1.0:1789518158.097344:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 175 00000100:00100000:1.0:1789518158.097357:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff69ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+18:11477:x1876445617004800:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789518158.097431:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518158.097957:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c78184f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9ac expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518158.098221:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99ffc2ad3300) 00010000:00010000:1.0:1789518158.098241:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518158.098283:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c78185d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518158.098334:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c78185d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518158.098349:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c78185d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518158.098489:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7c00/0x631fd8698c781864 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xd65a1b68 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518158.098514:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7c00/0x631fd8698c781864 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd65a1b68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518158.098526:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7c00/0x631fd8698c781864 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd65a1b68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518158.098768:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c78185d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518158.098777:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c78185d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518158.098785:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c78185d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518158.098792:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518158.098797:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c78185d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518158.098805:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c78185d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518158.098817:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99ffc2fdc600) 00010000:00010000:1.0:1789518158.098828:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518158.098833:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c78185d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518158.098839:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7800/0x631fd8698c78185d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518158.098852:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7c00/0x631fd8698c781864 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd65a1b68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518158.098870:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7c00/0x631fd8698c781864 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd65a1b68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518158.098877:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7c00/0x631fd8698c781864 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd65a1b68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518158.098883:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518158.098885:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7c00/0x631fd8698c781864 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd65a1b68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518158.098904:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7c00/0x631fd8698c781864 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd65a1b68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518158.098912:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xd65a1b68 (ffff99ffc2fdc700) 00010000:00010000:1.0:1789518158.098915:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518158.098919:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7c00/0x631fd8698c781864 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd65a1b68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518158.098924:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7c00/0x631fd8698c781864 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd65a1b68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518158.099032:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff69ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+17:11477:x1876445617004800:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 1674us (2880us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789518158.099047:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 175 00000100:00100000:0.0:1789518158.102519:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518158.104793:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617004928 00000100:00100000:3.0:1789518158.104814:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617004928 00000100:00100000:2.0:1789518158.105025:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 176 00000100:00100000:2.0:1789518158.105038:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffffff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+17:11477:x1876445617004928:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518158.105064:0:8051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518158.105094:0:8051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c78186b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc9b3 expref: -99 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.105138:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781872 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.105154:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.105167:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.105294:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c78186b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9b3 expref: 19 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.105316:0:8051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781872 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9b3 expref: 18 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.105326:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99ffc2ad3500) 00010000:00010000:2.0:1789518158.105329:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789518158.105334:0:8051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696e00, rc 0) 00000100:00100000:2.0:1789518158.105458:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffffff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+18:11477:x1876445617004928:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 422us (2951us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518158.105466:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 176 00000100:00100000:0.0:1789518158.107786:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518158.107834:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617005184 00000100:00100000:1.0:1789518158.107847:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617005184 00000100:00100000:1.0:1789518158.107927:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 177 00000100:00100000:1.0:1789518158.107939:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+18:11477:x1876445617005184:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789518158.108045:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c781879 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518158.108064:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c781879 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518158.108077:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c781879 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789518158.108475:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1789518158.108488:0:5812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 212104873728ns, next at 213104871212ns, rc = 0 00000004:00010000:1.0:1789518158.108602:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2c9c554 reply state 00000000965ad61a transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c781879 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518158.108610:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789518158.108862:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+20:11477:x1876445617005184:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 923us (1086us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1789518158.108870:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 177 00000100:00100000:3.0:1789518158.110490:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:1.0:1789518158.110748:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c781879 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518158.110761:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c781879 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518158.110791:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c781879 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518158.110797:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518158.110802:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c781879 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518158.110811:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c781879 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518158.110829:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99ffc2ad3500) 00010000:00010000:1.0:1789518158.110833:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789518158.110839:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c781879 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518158.110845:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c781879 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518158.111037:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617005312 00000100:00100000:0.0:1789518158.111056:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617005312 00000100:00100000:0.0:1789518158.111130:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 178 00000100:00100000:0.0:1789518158.111141:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff69f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+19:11477:x1876445617005312:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518158.111168:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518158.111188:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c781880 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc9ba expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.111250:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c781880 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9ba expref: 20 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.111265:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c781880 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9ba expref: 20 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.111286:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99ffc2ad3500) 00010000:00010000:0.0:1789518158.111289:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518158.111292:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc400, rc 0) 00000100:00100000:0.0:1789518158.111361:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff69f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+20:11477:x1876445617005312:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 221us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518158.111368:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 178 00000100:00100000:0.0:1789518158.114342:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518158.118107:0:8784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617005440 00000100:00100000:2.0:1789518158.118128:0:8784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617005440 00000100:00080000:0.0:1789518158.118291:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518158.118386:0:6647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 51 00000100:00100000:3.0:1789518158.118402:0:6647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2342:x1876445617005440:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789518158.118936:0:6647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:2342:x1876445617005440:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 536us (4604us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1789518158.118954:0:6647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 51 00000100:00100000:1.0:1789518158.122424:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518158.122660:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617005696 00000100:00100000:2.0:1789518158.122673:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617005696 00000100:00100000:2.0:1789518158.122746:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:2.0:1789518158.122759:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff64f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+20:11477:x1876445617005696:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789518158.123197:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff64f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+21:11477:x1876445617005696:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 440us (792us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1789518158.123206:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:1.0:1789518158.126535:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518158.126728:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617005952 00000100:00100000:0.0:1789518158.126741:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617005952 00000100:00100000:0.0:1789518158.126844:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 179 00000100:00100000:0.0:1789518158.126859:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff64c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+21:11477:x1876445617005952:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789518158.127025:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff64c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+21:11477:x1876445617005952:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 171us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518158.127066:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 179 00000100:00100000:0.0:1789518158.129889:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518158.130699:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617006080 00000100:00100000:2.0:1789518158.130717:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617006080 00000100:00100000:2.0:1789518158.130847:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 180 00000100:00100000:2.0:1789518158.130860:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+21:11477:x1876445617006080:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518158.130887:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518158.130923:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781887 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc9c1 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.131011:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c78188e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.131028:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c78188e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.131042:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c78188e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518158.131087:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518158.131110:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c78188e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.131142:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781887 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9c1 expref: 23 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.131181:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c78188e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9c1 expref: 22 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.131191:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99ffc2ad3500) 00010000:00010000:2.0:1789518158.131194:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789518158.131199:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696a00, rc 0) 00000100:00100000:2.0:1789518158.131285:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+22:11477:x1876445617006080:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 427us (1413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518158.131292:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 180 00000100:00100000:2.0:1789518158.135921:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518158.136031:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617006208 00000100:00100000:0.0:1789518158.136044:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617006208 00000100:00100000:0.0:1789518158.136111:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 52 00000100:00100000:0.0:1789518158.136123:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:2343:x1876445617006208:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518158.136399:0:6648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518158.136438:0:6648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042ecff79/0x631fd8698c781895 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc9c8 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518158.136472:0:6648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa9e14e, blocks: 0x1 00010000:00010000:0.0:1789518158.136498:0:6648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=212s v=(0 0) 00010000:00010000:0.0:1789518158.136503:0:6648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518158.136513:0:6648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042ecff79/0x631fd8698c781895 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9c8 expref: 8 pid: 6648 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.136536:0:6648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000042ecff79/0x631fd8698c781895 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9c8 expref: 8 pid: 6648 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.136551:0:6648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bcc00, rc 0) 00000100:00100000:0.0:1789518158.136665:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+8:2343:x1876445617006208:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 544us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518158.136672:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 52 00000100:00100000:1.0:1789518158.139358:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518158.139497:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617006464 00000100:00100000:0.0:1789518158.139577:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617006464 00000100:00100000:0.0:1789518158.139928:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 181 00000100:00100000:0.0:1789518158.139942:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff64d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+22:11477:x1876445617006464:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789518158.140448:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff64d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+22:11477:x1876445617006464:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 507us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518158.140458:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 181 00000100:00100000:1.0:1789518158.142740:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518158.142878:0:8784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617006592 00000100:00100000:2.0:1789518158.142889:0:8784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617006592 00000100:00100000:2.0:1789518158.142970:0:8784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 53 00000100:00100000:2.0:1789518158.142982:0:8784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff64ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+8:11477:x1876445617006592:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518158.143004:0:8784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518158.143029:0:8784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000460f3ef9/0x631fd8698c78189c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc9cf expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.143355:0:8784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000042ecff79/0x631fd8698c781895 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9c8 expref: 9 pid: 6648 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.143367:0:8784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518158.143373:0:8784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518158.143380:0:8784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000460f3ef9/0x631fd8698c78189c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9cf expref: 9 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.143446:0:8784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000042ecff79/0x631fd8698c781895 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9c8 expref: 9 pid: 6648 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.143462:0:8784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000042ecff79/0x631fd8698c781895 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9c8 expref: 9 pid: 6648 timeout: 312 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518158.143478:0:8784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a5ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8784:1876445627478272:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518158.143815:0:8784:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc4c410c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518158.147409:0:8784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a5ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8784:1876445627478272:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518158.147450:0:8784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000460f3ef9/0x631fd8698c78189c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9cf expref: 9 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.147471:0:8784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697e00, rc 0) 00000100:00100000:0.0:1789518158.147554:0:8784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff64ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+9:11477:x1876445617006592:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 4573us (4823us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518158.147564:0:8784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 53 00000100:00100000:2.0:1789518158.147572:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518158.147657:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617006720 00000100:00100000:3.0:1789518158.147667:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617006720 00010000:00010000:3.0:1789518158.147705:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000042ecff79/0x631fd8698c781895 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9c8 expref: 9 pid: 6648 timeout: 312 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518158.147745:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 70 00000100:00100000:3.0:1789518158.147755:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd8065050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+9:2342:x1876445617006720:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518158.147772:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518158.147799:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000042ecff79/0x631fd8698c781895 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9c8 expref: 9 pid: 6648 timeout: 312 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518158.147814:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000042ecff79/0x631fd8698c781895 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9c8 expref: 9 pid: 6648 timeout: 312 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518158.147858:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042ecff79/0x631fd8698c781895 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9c8 expref: 9 pid: 6648 timeout: 312 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518158.147910:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518158.147915:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518158.147926:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000460f3ef9/0x631fd8698c78189c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9cf expref: 8 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518158.147992:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000460f3ef9/0x631fd8698c78189c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9cf expref: 8 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518158.148033:0:5797:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000460f3ef9/0x631fd8698c78189c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9cf expref: 8 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518158.148050:0:5797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff69c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5797:1876445627478400:192.168.206.51@tcp:105: 00000100:00100000:3.0:1789518158.148128:0:5797:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc514ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789518158.150330:0:5797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff69c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5797:1876445627478400:192.168.206.51@tcp:105: 00010000:00010000:3.0:1789518158.150365:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518158.150428:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd8065050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+8:2342:x1876445617006720:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 2674us (2858us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518158.150440:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 70 00000100:00100000:1.0:1789518158.151471:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518158.151599:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617006848 00000100:00100000:2.0:1789518158.151609:0:6655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617006848 00002000:00100000:2.0:1789518158.151711:0:6655:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff99ffff64dc00 x1876445617006848/t0(0) o4->cfa1c47d-1425-4fe5-be2a-28ad5152a12d@192.168.206.51@tcp:559/0 lens 504/0 e 0 to 0 dl 1789518169 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518158.151723:0:6655:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffff64dc00 with x1876445617006848 ext(0->8) 00002000:00010000:2.0:1789518158.151729:0:6655:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffff64dc00 00000100:00100000:2.0:1789518158.151758:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:2.0:1789518158.151769:0:6655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff64dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+8:2342:x1876445617006848:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789518158.152330:0:6655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff64dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+10:2342:x1876445617006848:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 561us (863us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789518158.152340:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00002000:00100000:2.0:1789518158.152347:0:6655:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff99ffff64dc00 x1876445617006848/t4294967314(0) o4->cfa1c47d-1425-4fe5-be2a-28ad5152a12d@192.168.206.51@tcp:559/0 lens 504/448 e 0 to 0 dl 1789518169 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518158.152356:0:6655:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffff64dc00 with x1876445617006848 ext(0->8) 00002000:00010000:2.0:1789518158.152366:0:6655:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffff64dc00 00000100:00100000:1.0:1789518158.154807:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518158.154933:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617006976 00000100:00100000:2.0:1789518158.154945:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617006976 00000100:00100000:2.0:1789518158.155017:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 182 00000100:00100000:2.0:1789518158.155030:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff64fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+22:11477:x1876445617006976:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789518158.175681:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:1.0:1789518158.175696:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:1.0:1789518158.175721:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:1.0:1789518158.175734:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:3.0:1789518158.175797:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff64fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+18:11477:x1876445617006976:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 Request processed in 20760us (20992us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518158.175811:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 182 00000100:00100000:0.0:1789518158.175865:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789518158.175883:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff633800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627478528:0@lo:2:osp-syn-1-0.0 00000020:00080000:2.0:1789518158.175963:0:5844:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1789518158.175974:0:5844:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1789518158.176053:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518158.176212:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627478528 00000100:00100000:2.0:1789518158.176220:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627478528 00000100:00100000:2.0:1789518158.176312:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789518158.176327:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627478528:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789518158.176497:0:6648:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789518158.176501:0:6648:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789518158 00002000:00010000:2.0:1789518158.176504:0:6648:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789518158.176506:0:6648:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789518158 -> 1789518158 00002000:00010000:2.0:1789518158.176509:0:6648:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789518158.176555:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3283:x1876445627478528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 230us (502us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789518158.176561:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:1.0:1789518158.176649:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99ffff633800/2, rc 0, transno 4294967315 00000100:00100000:1.0:1789518158.176655:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff633800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627478528:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789518158.178876:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518158.178949:0:6647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617007104 00000100:00100000:3.0:1789518158.178962:0:6647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617007104 00000100:00100000:3.0:1789518158.179036:0:6647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 55 00000100:00100000:3.0:1789518158.179165:0:6647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff64ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+10:2343:x1876445617007104:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789518158.211385:0:6647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff64ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+10:2343:x1876445617007104:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 Request processed in 32208us (32506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518158.211402:0:6647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 55 00000001:00080000:3.0:1789518158.211452:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:3.0:1789518158.211461:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:1.0:1789518158.216997:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518158.217171:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617007360 00000100:00100000:0.0:1789518158.217185:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617007360 00000100:00100000:0.0:1789518158.217264:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 183 00000100:00100000:0.0:1789518158.217273:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff64e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+18:11477:x1876445617007360:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789518158.217340:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518158.217369:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c78188e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9c1 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.217387:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99ffc2ad3500) 00010000:00010000:0.0:1789518158.217404:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518158.217436:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c7818a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.217449:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c7818a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.217457:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c7818a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518158.217773:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d1438a8 reply state 00000000f101032d transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c7818a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518158.217780:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518158.217913:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff64e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+19:11477:x1876445617007360:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 638us (933us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1789518158.217921:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 183 00010000:00010000:3.0:1789518158.222149:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c7818a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518158.222170:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c7818a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518158.222178:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c7818a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518158.222184:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bcc00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518158.222190:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c7818a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518158.222199:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c7818a3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518158.222220:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99ffc2ad3500) 00010000:00010000:3.0:1789518158.222223:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518158.222229:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c7818a3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518158.222235:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c7818a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518158.222865:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518158.223191:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617007488 00000100:00100000:0.0:1789518158.223203:0:6649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617007488 00000100:00100000:0.0:1789518158.223273:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 56 00000100:00100000:0.0:1789518158.223285:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff64df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:2342:x1876445617007488:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789518158.223975:0:6649:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1789518158.223980:0:6649:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789518158 -> 1789518157 00002000:00010000:0.0:1789518158.223983:0:6649:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789518156 00002000:00010000:0.0:1789518158.223985:0:6649:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789518158 -> 1789518157 00002000:00010000:0.0:1789518158.223987:0:6649:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789518158.224102:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff64df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+8:2342:x1876445617007488:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 818us (1242us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789518158.224111:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 56 00000100:00100000:0.0:1789518158.226710:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518158.226987:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617007744 00000100:00100000:2.0:1789518158.226997:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617007744 00000100:00100000:2.0:1789518158.227087:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 184 00000100:00100000:2.0:1789518158.227098:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff6f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+18:11477:x1876445617007744:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789518158.227195:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7818aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.227216:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781872 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9b3 expref: 18 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.227241:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7818aa lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.227281:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781872 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9b3 expref: 18 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.227304:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781872 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9b3 expref: 18 pid: 8051 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518158.227322:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a5b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1876445627478656:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518158.227425:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc4c41480 going to sleep for 11 seconds 00000100:00100000:3.0:1789518158.230416:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518158.230508:0:7597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617007872 00000100:00100000:0.0:1789518158.230520:0:7597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617007872 00010000:00010000:0.0:1789518158.230568:0:7597:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781872 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9b3 expref: 19 pid: 8051 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518158.230603:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a5b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1876445627478656:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518158.230649:0:7597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 71 00010000:00010000:2.0:1789518158.230655:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7818aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518158.230660:0:7597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff69c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+19:2343:x1876445617007872:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518158.230679:0:7597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518158.230687:0:7597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781872 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9b3 expref: 19 pid: 8051 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.230698:0:7597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781872 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9b3 expref: 19 pid: 8051 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.230717:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781872 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9b3 expref: 19 pid: 8051 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.230730:0:7597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99ffc2ad3500) 00010000:00010000:0.0:1789518158.230734:0:7597:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7818aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.230742:0:7597:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7818aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.230748:0:7597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7818aa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.230769:0:7597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518158.230794:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7818aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.230803:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7818aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518158.230820:0:7597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff69c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+18:2343:x1876445617007872:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 163us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518158.230826:0:7597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 71 00010000:00010000:2.0:1789518158.230837:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7818aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.230846:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7818aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.230855:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7818aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.230868:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518158.230873:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7818aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.230881:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7818aa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.230902:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99ffc2ad3500) 00010000:00010000:2.0:1789518158.230905:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789518158.230909:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7818aa lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.230916:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7818aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518158.230957:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff6f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+17:11477:x1876445617007744:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 Request processed in 3861us (4345us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789518158.230964:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 184 00000100:00100000:1.0:1789518158.234525:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518158.234680:0:8784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617008000 00000100:00100000:0.0:1789518158.234704:0:8784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617008000 00000100:00100000:0.0:1789518158.234775:0:8784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00100000:0.0:1789518158.234789:0:8784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff64f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+8:2342:x1876445617008000:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789518158.234846:0:8784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000098cacc6a/0x631fd8698c7818b1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.234872:0:8784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000460f3ef9/0x631fd8698c78189c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9cf expref: 8 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.234882:0:8784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518158.234906:0:8784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518158.234912:0:8784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098cacc6a/0x631fd8698c7818b1 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.234956:0:8784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000460f3ef9/0x631fd8698c78189c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9cf expref: 8 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.234973:0:8784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000460f3ef9/0x631fd8698c78189c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9cf expref: 8 pid: 8784 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518158.234992:0:8784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff6f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8784:1876445627478784:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518158.235210:0:8784:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbb5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789518158.242057:0:8784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff6f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8784:1876445627478784:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518158.242071:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:0.0:1789518158.242106:0:8784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000098cacc6a/0x631fd8698c7818b1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518158.242204:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617008128 00000100:00100000:2.0:1789518158.242213:0:5798:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617008128 00010000:00010000:2.0:1789518158.242259:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000460f3ef9/0x631fd8698c78189c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9cf expref: 9 pid: 8784 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518158.242344:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:2.0:1789518158.242357:0:5798:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff69d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+9:2342:x1876445617008128:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518158.242377:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518158.242407:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000460f3ef9/0x631fd8698c78189c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9cf expref: 9 pid: 8784 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.242444:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000460f3ef9/0x631fd8698c78189c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9cf expref: 9 pid: 8784 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.242486:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000460f3ef9/0x631fd8698c78189c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9cf expref: 9 pid: 8784 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.242507:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518158.242512:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518158.242518:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000098cacc6a/0x631fd8698c7818b1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.242530:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098cacc6a/0x631fd8698c7818b1 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.242566:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518158.242687:0:5798:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff69d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+8:2342:x1876445617008128:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 331us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518158.242696:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 72 00010000:00010000:0.0:1789518158.242760:0:8784:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000098cacc6a/0x631fd8698c7818b1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.242771:0:8784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098cacc6a/0x631fd8698c7818b1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.242802:0:8784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000098cacc6a/0x631fd8698c7818b1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.242823:0:8784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098cacc6a/0x631fd8698c7818b1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.242833:0:8784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098cacc6a/0x631fd8698c7818b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.242841:0:8784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bca00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518158.242846:0:8784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098cacc6a/0x631fd8698c7818b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.242855:0:8784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098cacc6a/0x631fd8698c7818b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.242883:0:8784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098cacc6a/0x631fd8698c7818b1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.242902:0:8784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098cacc6a/0x631fd8698c7818b1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518158.242972:0:8784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff64f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:2342:x1876445617008000:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 Request processed in 8187us (8526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518158.242985:0:8784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00100000:3.0:1789518158.245725:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518158.245923:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617008384 00000100:00100000:0.0:1789518158.245935:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617008384 00000100:00100000:0.0:1789518158.246012:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 185 00000100:00100000:0.0:1789518158.246024:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff69ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+17:11477:x1876445617008384:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789518158.246126:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7818b8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.246147:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7818b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.246160:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7818b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.246428:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c7818bf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.246441:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c781880 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9ba expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.246770:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c7818bf lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.246826:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c781880 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9ba expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.246842:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c781880 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9ba expref: 18 pid: 5811 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518158.246860:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff6f4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1876445627478912:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518158.246983:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbb5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789518158.249700:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff6f4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1876445627478912:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518158.249712:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:0.0:1789518158.249743:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c7818bf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518158.249866:0:7597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617008512 00000100:00100000:2.0:1789518158.249875:0:7597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617008512 00010000:00010000:2.0:1789518158.249929:0:7597:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c781880 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9ba expref: 19 pid: 5811 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518158.249974:0:7597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:2.0:1789518158.249984:0:7597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff64f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+19:2343:x1876445617008512:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518158.250019:0:7597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518158.250330:0:7597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c781880 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9ba expref: 19 pid: 5811 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.250344:0:7597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c781880 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9ba expref: 19 pid: 5811 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.250371:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c781880 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9ba expref: 19 pid: 5811 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.250392:0:7597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99ffc2ad3500) 00010000:00010000:2.0:1789518158.250397:0:7597:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c7818bf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.250407:0:7597:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c7818bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.250415:0:7597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c7818bf lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.250448:0:7597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518158.250577:0:7597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff64f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+18:2343:x1876445617008512:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 592us (869us total) trans 0 rc 0/0 00010000:00010000:0.0:1789518158.250579:0:5813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c7818bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518158.250590:0:7597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 73 00010000:00010000:0.0:1789518158.250591:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c7818bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789518158.250872:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1789518158.253244:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1789518158.253378:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1789518158.253487:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff6f4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5813:1876445627479040:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789518158.253566:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518158.253597:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbb50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518158.254178:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627479040 00000100:00100000:1.0:1789518158.254189:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627479040 00000100:00100000:1.0:1789518158.254256:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789518158.254268:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5813:x1876445627479040:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789518158.254383:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5813:x1876445627479040:12345-0@lo:1000:mdt00_002.0 Request processed in 117us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518158.254393:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789518158.255269:0:5813:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1789518158.255279:0:5813:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99ffff633800, transno 4294967315 00000100:00100000:0.0:1789518158.255372:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff6f4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5813:1876445627479040:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1789518158.257773:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1789518158.257905:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0792300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5813:1876445627479168:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789518158.257990:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518158.258041:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbb5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789518158.259963:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627479168 00000100:00100000:3.0:1789518158.259980:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627479168 00000100:00100000:3.0:1789518158.260213:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789518158.260227:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5813:x1876445627479168:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789518158.260595:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5813:x1876445627479168:12345-0@lo:1000:mdt00_002.0 Request processed in 370us (2603us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1789518158.260604:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1789518158.260751:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518158.260928:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0792300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5813:1876445627479168:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1789518158.260983:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c7818bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518158.260996:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c7818bf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518158.261005:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c7818bf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518158.261012:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bde00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518158.261017:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c7818bf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518158.261025:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c7818bf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518158.261043:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99ffc2ad3500) 00010000:00010000:3.0:1789518158.261047:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518158.261054:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c7818bf lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518158.261083:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c7818bf lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518158.261125:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7817f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518158.261132:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7817f4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518158.261139:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7817f4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518158.261144:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518158.261148:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7817f4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518158.261154:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7817f4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518158.261164:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2ad3e00) 00010000:00010000:3.0:1789518158.261166:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518158.261169:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7817f4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518158.261175:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7817f4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518158.261201:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7818c6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518158.261217:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c781810 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc99e expref: 21 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518158.261235:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7818c6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518158.261273:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c781810 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc99e expref: 21 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518158.261288:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c781810 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc99e expref: 21 pid: 5813 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518158.261304:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff69dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1876445627479296:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518158.261944:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc514a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518158.265022:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518158.265297:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617008640 00000100:00100000:1.0:1789518158.265308:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617008640 00010000:00010000:1.0:1789518158.265358:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c781810 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc99e expref: 22 pid: 5813 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518158.265407:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00100000:1.0:1789518158.265418:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff69fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+22:2343:x1876445617008640:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518158.265437:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518158.265454:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c781810 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc99e expref: 22 pid: 5813 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518158.265469:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c781810 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc99e expref: 22 pid: 5813 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518158.265525:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2ad3e00) 00010000:00010000:1.0:1789518158.265532:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7818c6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518158.265543:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7818c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518158.265552:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7818c6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518158.265575:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518158.265673:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff69fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+22:2343:x1876445617008640:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 256us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518158.265682:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 74 00010000:00010000:0.0:1789518158.265853:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c781810 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc99e expref: 21 pid: 5813 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518158.265872:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff69dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1876445627479296:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518158.265912:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7818c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.265923:0:5813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7818c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.265930:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7818c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.265945:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7818c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.265951:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7818c6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.265958:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7818c6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.265965:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518158.265979:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7818c6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.265988:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7818c6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.265998:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2ad3e00) 00010000:00010000:0.0:1789518158.266001:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518158.266006:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7818c6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.266012:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7818c6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.266023:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7818b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.266030:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7818b8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.266036:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7818b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.266041:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518158.266044:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7818b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.266050:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7818b8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.266056:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2ad3e00) 00010000:00010000:0.0:1789518158.266059:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789518158.266067:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7818b8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518158.266072:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7818b8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518158.266351:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff69ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+20:11477:x1876445617008384:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 20328us (20637us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1789518158.266361:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 185 00000020:00080000:0.0:1789518158.266366:0:5813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789518158.266756:0:11633:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789518158.266762:0:11633:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518158.267745:0:11633:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:2.0:1789518158.267759:0:11633:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789518158.269918:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518158.270124:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617008896 00000100:00100000:3.0:1789518158.270137:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617008896 00000100:00100000:3.0:1789518158.270208:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00100000:3.0:1789518158.270220:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfa70c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+20:11477:x1876445617008896:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789518158.272117:0:5815:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789518158.272252:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1789518158.272341:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7818cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518158.272361:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7818cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518158.272375:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7818cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518158.272397:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7818cd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518158.272405:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7818cd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518158.272411:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7818cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518158.272564:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789518158.272735:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfa70c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+22:11477:x1876445617008896:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 2511us (2835us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1789518158.272746:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 50 00000020:00080000:3.0:1789518158.272752:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789518158.273239:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518158.273258:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7818cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.273268:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16c00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518158.273274:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7818cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.273283:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7818cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.273301:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99ffd8781700) 00010000:00010000:2.0:1789518158.273305:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789518158.273312:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7818cd lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.273318:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7818cd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518158.273339:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518158.273341:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518158.273342:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518159.246847:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518159.246904:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518159.246935:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518159.246962:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518159.246987:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518159.247020:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617009152 00000100:00100000:3.0:1789518159.247032:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617009152 00000100:00100000:3.0:1789518159.247086:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617009536 00000100:00100000:3.0:1789518159.247089:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617009536 00000100:00100000:3.0:1789518159.247127:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 95 00000100:00100000:3.0:1789518159.247139:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff69e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+22:2342:x1876445617009152:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518159.247231:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff69e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+22:2342:x1876445617009152:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 95us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518159.247240:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 95 00000100:00100000:3.0:1789518159.247275:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 96 00000100:00100000:3.0:1789518159.247282:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff69df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2343:x1876445617009536:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518159.247313:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff69df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2343:x1876445617009536:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 32us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518159.247319:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 96 00000100:00100000:3.0:1789518159.247340:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617009280 00000100:00100000:3.0:1789518159.247344:0:6649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617009280 00000100:00100000:3.0:1789518159.247372:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617009408 00000100:00100000:3.0:1789518159.247375:0:6649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617009408 00000100:00100000:3.0:1789518159.247394:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00100000:3.0:1789518159.247401:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff69ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2343:x1876445617009280:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518159.247426:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff69ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2343:x1876445617009280:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 27us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518159.247432:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00100000:2.0:1789518159.247557:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 58 00000100:00100000:2.0:1789518159.247567:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff69f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:2342:x1876445617009408:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518159.247593:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff69f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:2342:x1876445617009408:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 30us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518159.247599:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 58 00000100:00080000:2.0:1789518159.247656:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789518159.247661:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518159.247756:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617009024 00000100:00100000:1.0:1789518159.247761:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617009024 00000100:00100000:1.0:1789518159.247800:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 270 00000100:00100000:1.0:1789518159.247808:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+13:2343:x1876445617009024:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518159.247839:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e55716f-fc49-42ce-abad-050985078c82+13:2343:x1876445617009024:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 32us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518159.247845:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 270 00000040:00080000:2.0:1789518159.283115:0:11633:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789518159.283128:0:11633:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518159.283434:0:11633:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789518159.283442:0:11633:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789518159.283856:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518159.474847:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627479424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518159.474943:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518159.475009:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627479424 00000100:00100000:3.0:1789518159.475023:0:6652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627479424 00000100:00080000:2.0:1789518159.475089:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518159.475148:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789518159.475160:0:6651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff6f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1876445627479424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789518159.475207:0:6651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789518159.477196:0:6651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff6f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1876445627479424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2027us (2240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518159.477212:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789518159.477896:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1789518159.477906:0:3283:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1789518159.477983:0:3283:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff99fff7882a00 x1876445627478016/t4294967307(4294967307) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789518173 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518159.478005:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627479424:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1789518159.526128:0:12513:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789518159.526137:0:12513:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518159.526176:0:12513:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789518159.526181:0:12513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789518159.621413:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518159.621464:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617009792 00000100:00100000:0.0:1789518159.621476:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617009792 00000100:00100000:0.0:1789518159.621541:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 186 00000100:00100000:0.0:1789518159.621553:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+22:11495:x1876445617009792:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518159.621578:0:8051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518159.621603:0:8051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7818d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc9d6 expref: -99 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518159.621743:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c7818db lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518159.621772:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c7818db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518159.621785:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c7818db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518159.621799:0:8051:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1789518159.621958:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7818d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9d6 expref: 25 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518159.621977:0:8051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c7818db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9d6 expref: 24 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518159.621987:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99ffc2fdc600) 00010000:00010000:0.0:1789518159.621990:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789518159.621994:0:8051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd800, rc 0) 00000100:00100000:0.0:1789518159.622062:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+24:11495:x1876445617009792:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 510us (663us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1789518159.622070:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 186 00000100:00100000:3.0:1789518159.625331:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518159.625373:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617009920 00000100:00100000:3.0:1789518159.625386:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617009920 00000100:00100000:3.0:1789518159.625462:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 187 00000100:00100000:3.0:1789518159.625473:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff69f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+24:11495:x1876445617009920:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:3.0:1789518159.625566:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7818e9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.625587:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7818e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.625599:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7818e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.625645:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7818f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.625655:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7818f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.625662:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7818f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.625937:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7818f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.625947:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7818f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.625954:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7818f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518159.626002:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7818f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.626017:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7818e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.626024:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7818e9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.626032:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7818e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.626040:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518159.626045:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7818e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.626060:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7818e9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.626074:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99ffc2fdc600) 00010000:00010000:3.0:1789518159.626078:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518159.626084:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7818e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.626091:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7818e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.626102:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7818f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.626109:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7818f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.626115:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7818f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.626120:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518159.626123:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7818f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.626130:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7818f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.626137:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99ffd8781000) 00010000:00010000:3.0:1789518159.626140:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518159.626142:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7818f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.626158:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7818f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.626174:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7818f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.626180:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7818f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.626186:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7818f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.626191:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518159.626194:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7818f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.626200:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7818f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.626208:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffd8781100) 00010000:00010000:3.0:1789518159.626210:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518159.626213:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7818f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.626219:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7818f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518159.626308:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff69f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+24:11495:x1876445617009920:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 836us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518159.626316:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 187 00000100:00100000:1.0:1789518159.654797:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518159.654961:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617010176 00000100:00100000:3.0:1789518159.654974:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617010176 00000100:00100000:3.0:1789518159.655084:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 188 00000100:00100000:3.0:1789518159.655096:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff64d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+24:11498:x1876445617010176:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518159.655137:0:8051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518159.655165:0:8051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7818fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc9dd expref: -99 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.655260:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781905 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.655383:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781905 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.655402:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781905 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.655420:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78190c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.655429:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78190c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.655435:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78190c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.657225:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c781913 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.657245:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c781913 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.657258:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c781913 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518159.657272:0:8051:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1789518159.657383:0:8051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781905 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.657391:0:8051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781905 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.657398:0:8051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781905 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.657414:0:8051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518159.657419:0:8051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781905 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.657427:0:8051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781905 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.657441:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99ffc2fdc600) 00010000:00010000:2.0:1789518159.657444:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518159.657451:0:8051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781905 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.657457:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781905 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.657471:0:8051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78190c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.657476:0:8051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78190c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.657482:0:8051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78190c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.657487:0:8051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518159.657490:0:8051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78190c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.657495:0:8051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78190c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.657511:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99ffd8781100) 00010000:00010000:2.0:1789518159.657513:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518159.657516:0:8051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78190c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.657522:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78190c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.657576:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7818fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9dd expref: 27 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.657591:0:8051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c781913 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9dd expref: 26 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.657597:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2ad3000) 00010000:00010000:2.0:1789518159.657600:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518159.657602:0:8051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696600, rc 0) 00000100:00100000:2.0:1789518159.657724:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff64d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+26:11498:x1876445617010176:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 2629us (2937us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1789518159.657733:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 188 00000100:00100000:3.0:1789518159.662025:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518159.662206:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617010304 00000100:00100000:2.0:1789518159.662218:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617010304 00000100:00100000:2.0:1789518159.662370:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 189 00000100:00100000:2.0:1789518159.662383:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff69d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+26:11498:x1876445617010304:12345-192.168.206.51@tcp:54:lfs.0 00010000:00010000:2.0:1789518159.662471:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781921 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.662503:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.662536:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.662570:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.662578:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781921 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.662586:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781921 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.662593:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518159.662598:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781921 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.662606:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781921 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.662655:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2ad3000) 00010000:00010000:2.0:1789518159.662659:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789518159.662665:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781921 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.662671:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c781921 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518159.662761:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff69d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+26:11498:x1876445617010304:12345-192.168.206.51@tcp:54:lfs.0 Request processed in 380us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518159.662769:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 189 00000100:00100000:1.0:1789518159.664507:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518159.664564:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617010560 00000100:00100000:2.0:1789518159.664588:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617010560 00000100:00100000:2.0:1789518159.664678:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 51 00000100:00100000:2.0:1789518159.664689:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff64c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+26:11498:x1876445617010560:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:2.0:1789518159.665904:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff64c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+27:11498:x1876445617010560:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 1197us (1387us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1789518159.665916:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 51 00000100:00100000:1.0:1789518159.695805:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518159.695911:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617010816 00000100:00100000:0.0:1789518159.695925:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617010816 00000100:00100000:0.0:1789518159.696002:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 190 00000100:00100000:0.0:1789518159.696014:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff64f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+27:11025:x1876445617010816:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:0.0:1789518159.696047:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518159.696077:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c781928 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc9e4 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518159.696513:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78192f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518159.696530:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c781913 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9dd expref: 28 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518159.696540:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78192f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518159.697292:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c781913 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9dd expref: 28 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518159.697316:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c781913 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9dd expref: 28 pid: 8051 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518159.697335:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4000700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1876445627479552:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518159.697820:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd81bfc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518159.699704:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4000700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1876445627479552:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518159.699855:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78192f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518159.700360:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518159.700987:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617010944 00000100:00100000:2.0:1789518159.701000:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617010944 00010000:00010000:2.0:1789518159.701056:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c781913 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9dd expref: 29 pid: 8051 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518159.701110:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00100000:2.0:1789518159.701134:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff633800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+29:2342:x1876445617010944:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518159.701154:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518159.701162:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c781913 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9dd expref: 29 pid: 8051 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.701176:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c781913 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9dd expref: 29 pid: 8051 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.701203:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c781913 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9dd expref: 29 pid: 8051 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.701229:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2ad3000) 00010000:00010000:2.0:1789518159.701236:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78192f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.701271:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78192f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.701281:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78192f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.701327:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518159.701407:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff633800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+28:2342:x1876445617010944:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 274us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518159.701415:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 75 00010000:00010000:3.0:1789518159.701724:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78192f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.701734:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78192f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518159.701768:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789518159.702037:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c781928 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9e4 expref: 29 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.702057:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78192f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9e4 expref: 28 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.702066:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2ad3000) 00010000:00010000:3.0:1789518159.702068:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789518159.702072:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bce00, rc 0) 00000100:00100000:3.0:1789518159.702120:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff64f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+28:11025:x1876445617010816:12345-192.168.206.51@tcp:101:bash.0 Request processed in 6109us (6333us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1789518159.702128:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 190 00000100:00100000:1.0:1789518159.704114:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518159.704237:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617011200 00000100:00100000:3.0:1789518159.704250:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617011200 00000100:00100000:3.0:1789518159.704324:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 191 00000100:00100000:3.0:1789518159.704335:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+28:11025:x1876445617011200:12345-192.168.206.51@tcp:36:bash.0 00010000:00010000:3.0:1789518159.705146:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c78193d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.705172:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c78193d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.705186:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c78193d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789518159.705311:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1789518159.705366:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ea6a0456 reply state 00000000960919bd transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c78193d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518159.705377:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789518159.705508:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1789518159.705876:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+32:11025:x1876445617011200:12345-192.168.206.51@tcp:36:bash.0 Request processed in 1538us (1770us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1789518159.705896:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 191 00000020:00080000:3.0:1789518159.705903:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789518159.709993:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518159.710102:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617011328 00000100:00100000:2.0:1789518159.710114:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617011328 00000100:00100000:2.0:1789518159.710183:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 192 00000100:00100000:2.0:1789518159.710195:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4000700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+32:11025:x1876445617011328:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1789518159.710227:0:8051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518159.710265:0:8051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c781944 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc9eb expref: -99 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.710347:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c781944 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9eb expref: 33 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.710364:0:8051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c781944 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9eb expref: 33 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.710399:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2ad3000) 00010000:00010000:2.0:1789518159.710403:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518159.710408:0:8051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696600, rc 0) 00000100:00100000:2.0:1789518159.710498:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4000700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+33:11025:x1876445617011328:12345-192.168.206.51@tcp:101:bash.0 Request processed in 305us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518159.710507:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 192 00010000:00010000:1.0:1789518159.710967:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c78193d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518159.710978:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c78193d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518159.710986:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c78193d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518159.710992:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518159.710997:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c78193d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518159.711006:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c78193d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518159.711019:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2ad3000) 00010000:00010000:1.0:1789518159.711022:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518159.711026:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c78193d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518159.711033:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c78193d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518159.712747:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518159.714378:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617011456 00000100:00100000:2.0:1789518159.714452:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617011456 00000100:00100000:2.0:1789518159.714607:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 58 00000100:00100000:2.0:1789518159.714648:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:11025:x1876445617011456:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1789518159.714671:0:6648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518159.714697:0:6648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e2fb305/0x631fd8698c78194b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc9f2 expref: -99 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518159.714729:0:6648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa9e14d, atime: 0x6aa9e14c, ctime: 0x6aa9e14d, blocks: 0xb 00010000:00010000:2.0:1789518159.714756:0:6648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=213s v=(0 0) 00010000:00010000:2.0:1789518159.714761:0:6648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518159.714771:0:6648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e2fb305/0x631fd8698c78194b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9f2 expref: 8 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.714789:0:6648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002e2fb305/0x631fd8698c78194b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9f2 expref: 8 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.714804:0:6648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696000, rc 0) 00000100:00100000:2.0:1789518159.714908:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+8:11025:x1876445617011456:12345-192.168.206.51@tcp:101:bash.0 Request processed in 263us (2170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518159.714916:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 58 00000100:00100000:3.0:1789518159.719464:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518159.719671:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617011584 00000100:00100000:2.0:1789518159.719683:0:6653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617011584 00002000:00010000:2.0:1789518159.719754:0:6653:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1789518159.719760:0:6653:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffff69c700 with x1876445617011584 ext(0->18446744073709551615) 00002000:00010000:2.0:1789518159.719955:0:6653:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffff69c700. 00000100:00100000:2.0:1789518159.719993:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:2.0:1789518159.720007:0:6653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff69c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+8:2342:x1876445617011584:12345-192.168.206.51@tcp:10:bash.0 00000100:00100000:1.0:1789518159.720007:0:6654:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1789518159.720020:0:6654:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00002000:00010000:2.0:1789518159.721413:0:6653:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789518159.721419:0:6653:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789518157 -> 1789518160 00002000:00010000:2.0:1789518159.721422:0:6653:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1789518156 -> 1789518156 00002000:00010000:2.0:1789518159.721424:0:6653:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789518157 -> 1789518160 00002000:00010000:2.0:1789518159.721425:0:6653:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1789518159.721510:0:6653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff69c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+9:2342:x1876445617011584:12345-192.168.206.51@tcp:10:bash.0 Request processed in 1504us (2056us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1789518159.721518:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00002000:00010000:2.0:1789518159.721522:0:6653:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1789518159.721525:0:6653:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffff69c700 with x1876445617011584 ext(0->18446744073709551615) 00002000:00010000:2.0:1789518159.721531:0:6653:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffff69c700. 00000100:00100000:0.0:1789518159.769787:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518159.769942:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617011712 00000100:00100000:2.0:1789518159.769955:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617011712 00000100:00100000:2.0:1789518159.770080:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 193 00000100:00100000:2.0:1789518159.770092:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4001c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+32:11512:x1876445617011712:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:2.0:1789518159.770201:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c781952 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.770223:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c781952 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.770238:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c781952 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.770275:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c781959 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.770284:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c781959 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.770291:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c781959 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.770577:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c781960 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.770587:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c781960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.770594:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c781960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518159.770667:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c781960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.770680:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c781952 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.770686:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c781952 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.770694:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c781952 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.770700:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518159.770706:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c781952 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.770720:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c781952 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.770734:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99ffc2fdc600) 00010000:00010000:2.0:1789518159.770737:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518159.770743:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c781952 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.770749:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c781952 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.770762:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c781959 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.770768:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c781959 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.770773:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c781959 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.770779:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518159.770782:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c781959 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.770788:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c781959 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.770793:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99ffc2ad3200) 00010000:00010000:2.0:1789518159.770795:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518159.770798:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c781959 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.770813:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c781959 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.770830:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c781960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.771807:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c781960 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.771822:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c781960 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.771827:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518159.771951:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c781960 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.771960:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c781960 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.771977:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2ad3000) 00010000:00010000:2.0:1789518159.771979:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518159.771984:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c781960 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.771991:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c781960 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518159.772183:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4001c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+32:11512:x1876445617011712:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 2025us (2864us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518159.772195:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 193 00000100:00100000:1.0:1789518159.801983:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518159.802105:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617011968 00000100:00100000:3.0:1789518159.802119:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617011968 00000100:00100000:3.0:1789518159.802191:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 194 00000100:00100000:3.0:1789518159.802203:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+32:11515:x1876445617011968:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518159.802230:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518159.802258:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781967 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfc9f9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.802362:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78196e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.802379:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78196e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.802394:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78196e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.802411:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781975 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.802418:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.802456:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.803024:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c78197c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.803036:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c78197c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.803045:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c78197c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518159.803057:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789518159.803188:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78196e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.803198:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78196e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.803206:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78196e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.803212:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518159.803217:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78196e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.803226:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78196e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.803239:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99ffc2fdc600) 00010000:00010000:3.0:1789518159.803242:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518159.803257:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78196e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.803263:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78196e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.803418:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.803425:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781975 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.803431:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781975 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.803701:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518159.803704:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781975 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.803711:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781975 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.803719:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99ffd8781000) 00010000:00010000:3.0:1789518159.803722:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518159.803725:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781975 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.803731:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781975 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.803784:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c781967 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9f9 expref: 35 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.803815:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c78197c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9f9 expref: 34 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.803822:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2ad3000) 00010000:00010000:3.0:1789518159.803825:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789518159.803828:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17800, rc 0) 00000100:00100000:3.0:1789518159.803926:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+34:11515:x1876445617011968:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1724us (1957us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1789518159.803934:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 194 00000100:00100000:1.0:1789518159.806991:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518159.807210:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617012096 00000100:00100000:0.0:1789518159.807223:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617012096 00000100:00100000:0.0:1789518159.807293:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 195 00000100:00100000:0.0:1789518159.807307:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+34:11515:x1876445617012096:12345-192.168.206.51@tcp:54:lfs.0 00010000:00010000:0.0:1789518159.807414:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78198a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518159.807435:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78192f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9e4 expref: 34 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518159.807445:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78198a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518159.807488:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78192f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9e4 expref: 34 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518159.807505:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78192f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9e4 expref: 34 pid: 5811 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518159.807521:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4000e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1876445627479680:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518159.807668:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd81bfc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789518159.812526:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518159.812660:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617012352 00000100:00100000:3.0:1789518159.812673:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617012352 00000100:00100000:3.0:1789518159.812740:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 52 00000100:00100000:3.0:1789518159.812752:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+35:9919:x1876445617012352:12345-192.168.206.51@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789518159.813196:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+36:9919:x1876445617012352:12345-192.168.206.51@tcp:35:ldlm_bl.0 Request processed in 445us (683us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1789518159.813206:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 52 00000100:00100000:0.0:1789518159.814007:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4000e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1876445627479680:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518159.814043:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78198a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518159.815548:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518159.815995:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617012480 00000100:00100000:3.0:1789518159.816008:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617012480 00010000:00010000:3.0:1789518159.816059:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78192f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9e4 expref: 36 pid: 5811 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518159.816112:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00100000:3.0:1789518159.816123:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+36:2342:x1876445617012480:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518159.816141:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518159.816164:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78192f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9e4 expref: 36 pid: 5811 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.816178:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78192f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9e4 expref: 36 pid: 5811 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.816205:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78192f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9e4 expref: 36 pid: 5811 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.816223:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2ad3000) 00010000:00010000:3.0:1789518159.816230:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78198a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.816242:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78198a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.816250:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78198a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.816288:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518159.816356:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+35:2342:x1876445617012480:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 234us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518159.816364:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 76 00010000:00010000:0.0:1789518159.817963:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78198a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518159.817981:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78198a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518159.818035:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78198a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518159.818065:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78198a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518159.818074:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78198a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518159.818081:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518159.818087:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78198a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518159.818096:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78198a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518159.818115:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2ad3000) 00010000:00010000:0.0:1789518159.818118:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789518159.818123:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78198a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518159.818130:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78198a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518159.818242:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+34:11515:x1876445617012096:12345-192.168.206.51@tcp:54:lfs.0 Request processed in 10935us (11262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518159.818252:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 195 00000100:00100000:1.0:1789518159.822319:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518159.822909:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617012736 00000100:00100000:2.0:1789518159.822924:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617012736 00000100:00100000:2.0:1789518159.822995:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 53 00000100:00100000:2.0:1789518159.823007:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+34:11515:x1876445617012736:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:2.0:1789518159.823302:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+35:11515:x1876445617012736:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 296us (996us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1789518159.823310:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 53 00000100:00100000:1.0:1789518159.874100:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518159.875292:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617012992 00000100:00100000:2.0:1789518159.875365:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617012992 00000100:00100000:2.0:1789518159.875511:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 196 00000100:00100000:2.0:1789518159.875524:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+35:11526:x1876445617012992:12345-192.168.206.51@tcp:101:cat.0 00010000:00010000:2.0:1789518159.875557:0:8051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518159.875586:0:8051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c781991 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfca00 expref: -99 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.875692:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c781998 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.875712:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c781998 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.875727:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c781998 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.875746:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78199f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.875753:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78199f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.875785:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78199f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.876300:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c7819a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.876312:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c7819a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.876320:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c7819a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518159.876332:0:8051:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1789518159.876455:0:8051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c781998 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.876463:0:8051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c781998 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.876470:0:8051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c781998 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.876477:0:8051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518159.876482:0:8051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c781998 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.876490:0:8051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c781998 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.876504:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99ffc2fdc600) 00010000:00010000:2.0:1789518159.876507:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518159.876520:0:8051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c781998 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.876527:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c781998 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.876543:0:8051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78199f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.876550:0:8051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78199f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.876556:0:8051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78199f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.876562:0:8051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518159.876565:0:8051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78199f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.876571:0:8051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78199f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.876579:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99ffc2ad3200) 00010000:00010000:2.0:1789518159.876582:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518159.876585:0:8051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78199f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.876591:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78199f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.876702:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c781991 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca00 expref: 38 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.876729:0:8051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c7819a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca00 expref: 37 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.876736:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2ad3000) 00010000:00010000:2.0:1789518159.876739:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518159.876742:0:8051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696e00, rc 0) 00000100:00100000:2.0:1789518159.876823:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+37:11526:x1876445617012992:12345-192.168.206.51@tcp:101:cat.0 Request processed in 1301us (2736us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1789518159.876832:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 196 00000100:00100000:1.0:1789518159.882386:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518159.884372:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617013248 00000100:00100000:2.0:1789518159.884423:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617013248 00000100:00100000:2.0:1789518159.885738:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 54 00000100:00100000:2.0:1789518159.885760:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+37:11526:x1876445617013248:12345-192.168.206.51@tcp:35:cat.0 00000100:00100000:2.0:1789518159.886345:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+38:11526:x1876445617013248:12345-192.168.206.51@tcp:35:cat.0 Request processed in 595us (4072us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1789518159.886355:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 54 00000100:00100000:1.0:1789518159.909684:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518159.909792:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617013504 00000100:00100000:2.0:1789518159.909805:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617013504 00000100:00100000:2.0:1789518159.909877:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 197 00000100:00100000:2.0:1789518159.909901:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+38:11527:x1876445617013504:12345-192.168.206.51@tcp:36:rm.0 00010000:00010000:2.0:1789518159.909978:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789518159.910012:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c7819a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca00 expref: 38 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.910041:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c78197c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9f9 expref: 37 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.910079:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c781944 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9eb expref: 36 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.910091:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2ad3000) 00010000:00010000:2.0:1789518159.910105:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518159.910129:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7819b4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.910145:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7819b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.910158:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7819b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.910175:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c7819bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.910183:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c7819bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.910192:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c7819bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.910567:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c7819c2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.910576:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c7819c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.910833:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c7819c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789518159.911512:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1789518159.911524:0:5813:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 213907909531ns, next at 214907906938ns, rc = 0 00010000:00010000:2.0:1789518159.912133:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7819c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.912149:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7819c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.912160:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7819c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.912168:0:5813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7819c9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.912174:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7819c9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.912180:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7819c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.912212:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518159.912240:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c7819c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.912247:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c7819c2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.912254:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c7819c2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.912260:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518159.912275:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c7819c2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.912284:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c7819c2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.912298:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2ad3900) 00010000:00010000:2.0:1789518159.912301:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789518159.912399:0:7595:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518159.912408:0:7595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7819c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.912414:0:7595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696a00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518159.912418:0:7595:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7819c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.912440:0:7595:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7819c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.912450:0:7595:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99ffc2ad3900) 00010000:00010000:3.0:1789518159.912453:0:7595:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789518159.912529:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c7819c2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.912537:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c7819c2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.912560:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7819b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.912567:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7819b4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.912574:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7819b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.912664:0:7595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7819c9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.912673:0:7595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7819c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.912690:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518159.912692:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518159.912694:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518159.912781:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518159.912786:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7819b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.912793:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7819b4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.912802:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99ffc2fdc600) 00010000:00010000:2.0:1789518159.912804:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518159.912814:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7819b4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.912820:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7819b4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518159.912831:0:5813:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000036fc2484 reply state 00000000eb976760 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c7819bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518159.912840:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518159.912962:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+37:11527:x1876445617013504:12345-192.168.206.51@tcp:36:rm.0 Request processed in 3059us (3286us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1789518159.912972:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 197 00010000:00010000:3.0:1789518159.915016:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c7819bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.915036:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c7819bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.915045:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c7819bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.915053:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518159.915057:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c7819bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.915066:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c7819bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.915081:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99ffc2ad3200) 00010000:00010000:3.0:1789518159.915099:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518159.915105:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c7819bb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.915112:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c7819bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518159.939752:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518159.939960:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617013760 00000100:00100000:3.0:1789518159.939973:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617013760 00000100:00100000:3.0:1789518159.940093:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 198 00000100:00100000:3.0:1789518159.940105:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+36:11533:x1876445617013760:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:3.0:1789518159.940136:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518159.940162:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7819d0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfca07 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.940306:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7819d7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.940398:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7819d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.940413:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7819d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.940430:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c7819de lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.940437:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c7819de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.940445:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c7819de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789518159.942942:0:5811:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1789518159.943172:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7819e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.943191:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7819e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.943204:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7819e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.943242:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7819d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.943251:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7819d7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.943258:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7819d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.943266:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518159.943271:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7819d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.943280:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7819d7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.943294:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99ffc2fdc600) 00010000:00010000:3.0:1789518159.943297:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518159.943303:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7819d7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.943442:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7819d7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518159.943565:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051a4e006 reply state 00000000302e63e7 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c7819de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518159.943577:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789518159.943740:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7819d0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca07 expref: 39 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.943759:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7819e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca07 expref: 38 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.943768:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd8781100) 00010000:00010000:3.0:1789518159.943771:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518159.943774:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17800, rc 0) 00000100:00100000:3.0:1789518159.943871:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+39:11533:x1876445617013760:12345-192.168.206.51@tcp:101:bash.0 Request processed in 3766us (4133us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1789518159.943880:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 198 00010000:00010000:2.0:1789518159.947956:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c7819de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.947980:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c7819de lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.947989:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c7819de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.947998:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518159.948003:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c7819de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.948013:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c7819de lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.948035:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99ffd8781000) 00010000:00010000:2.0:1789518159.948039:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518159.948045:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c7819de lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.948072:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c7819de lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518159.948900:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518159.949426:0:8784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617013888 00000100:00100000:2.0:1789518159.949438:0:8784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617013888 00000100:00100000:2.0:1789518159.949921:0:8784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 59 00000100:00100000:2.0:1789518159.949934:0:8784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2344:x1876445617013888:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1789518159.949959:0:8784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518159.949982:0:8784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c7819f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfca0e expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518159.950013:0:8784:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518159.950036:0:8784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=213s v=(0 0) 00010000:00010000:2.0:1789518159.950231:0:8784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518159.950243:0:8784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c7819f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca0e expref: 6 pid: 8784 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.950266:0:8784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c7819f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca0e expref: 6 pid: 8784 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.950280:0:8784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697200, rc 0) 00000100:00100000:2.0:1789518159.950352:0:8784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2344:x1876445617013888:12345-192.168.206.51@tcp:101:bash.0 Request processed in 420us (1475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518159.950359:0:8784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 59 00000100:00100000:1.0:1789518159.953401:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518159.953794:0:6647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617014016 00000100:00100000:3.0:1789518159.953807:0:6647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617014016 00000100:00100000:3.0:1789518159.953873:0:6647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 60 00000100:00100000:3.0:1789518159.953896:0:6647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:11533:x1876445617014016:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:3.0:1789518159.953921:0:6647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518159.953943:0:6647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c7819fa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfca15 expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.954006:0:6647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c7819f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca0e expref: 7 pid: 8784 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.954017:0:6647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518159.954022:0:6647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518159.954028:0:6647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c7819fa lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca15 expref: 7 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.954922:0:6647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c7819f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca0e expref: 7 pid: 8784 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.954942:0:6647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c7819f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca0e expref: 7 pid: 8784 timeout: 313 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518159.954960:0:6647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff69ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6647:1876445627479808:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518159.955203:0:6647:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc514aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789518159.957958:0:6647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff69ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6647:1876445627479808:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518159.958001:0:6647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c7819fa lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca15 expref: 7 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518159.958027:0:6647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16600, rc 0) 00000100:00100000:3.0:1789518159.958232:0:6647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:11533:x1876445617014016:12345-192.168.206.51@tcp:101:bash.0 Request processed in 4348us (4841us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518159.958243:0:6647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 60 00000100:00100000:1.0:1789518159.958979:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518159.960911:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617014144 00000100:00100000:2.0:1789518159.960928:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617014144 00010000:00010000:2.0:1789518159.961002:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c7819f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca0e expref: 7 pid: 8784 timeout: 313 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518159.961253:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:2.0:1789518159.961266:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc81d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:2343:x1876445617014144:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518159.961286:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518159.961316:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c7819f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca0e expref: 7 pid: 8784 timeout: 313 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.961331:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c7819f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca0e expref: 7 pid: 8784 timeout: 313 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.961358:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c7819f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca0e expref: 7 pid: 8784 timeout: 313 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.961379:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518159.961384:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518159.961394:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c7819fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca15 expref: 6 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.961406:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c7819fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca15 expref: 6 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518159.961485:0:5799:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c7819fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca15 expref: 6 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518159.961515:0:5799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a5b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5799:1876445627479936:192.168.206.51@tcp:105: 00000100:00100000:2.0:1789518159.961671:0:5799:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a43600 going to sleep for 11 seconds 00000100:00100000:2.0:1789518159.964304:0:5799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a5b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5799:1876445627479936:192.168.206.51@tcp:105: 00010000:00010000:2.0:1789518159.964338:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518159.964405:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc81d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2343:x1876445617014144:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 3142us (5429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518159.964418:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:1.0:1789518159.965087:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518159.965266:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617014400 00000100:00100000:3.0:1789518159.965275:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617014400 00000100:00100000:3.0:1789518159.965331:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 55 00000100:00100000:3.0:1789518159.965342:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+38:11533:x1876445617014400:12345-192.168.206.51@tcp:35:bash.0 00000100:00100000:3.0:1789518159.965775:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+39:11533:x1876445617014400:12345-192.168.206.51@tcp:35:bash.0 Request processed in 433us (689us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1789518159.965782:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 55 00000100:00100000:1.0:1789518160.039927:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518160.041847:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617014528 00000100:00100000:0.0:1789518160.041864:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617014528 00000100:00080000:2.0:1789518160.041979:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518160.042004:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 199 00000100:00100000:0.0:1789518160.042017:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+39:11549:x1876445617014528:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518160.042051:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518160.042096:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c781a01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfca1c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.042184:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c781a08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.042202:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c781a08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.042218:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c781a08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518160.042261:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789518160.042265:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518160.042284:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c781a08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.042310:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c781a01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca1c expref: 41 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.042332:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c781a08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca1c expref: 40 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.042342:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99ffc2fdc600) 00010000:00010000:0.0:1789518160.042345:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789518160.042349:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bdc00, rc 0) 00000100:00100000:0.0:1789518160.042428:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+40:11549:x1876445617014528:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 413us (2513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518160.042435:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 199 00000100:00100000:1.0:1789518160.045832:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518160.046028:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617014784 00000100:00100000:2.0:1789518160.046042:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617014784 00000100:00100000:2.0:1789518160.046109:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 200 00000100:00100000:2.0:1789518160.046120:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+40:11549:x1876445617014784:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518160.046147:0:8051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518160.046173:0:8051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c781a0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfca23 expref: -99 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.046325:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c781a16 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.046342:0:8051:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7819e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca07 expref: 41 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.046352:0:8051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c781a16 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.046400:0:8051:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7819e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca07 expref: 41 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.046426:0:8051:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7819e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca07 expref: 41 pid: 5811 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518160.046506:0:8051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a5b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8051:1876445627480064:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518160.046777:0:8051:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a43480 going to sleep for 11 seconds 00000100:00100000:2.0:1789518160.052179:0:8051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a5b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8051:1876445627480064:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518160.052221:0:8051:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c781a16 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518160.053949:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518160.054107:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617014912 00000100:00100000:3.0:1789518160.054119:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617014912 00010000:00010000:3.0:1789518160.054166:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7819e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca07 expref: 42 pid: 5811 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518160.054212:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:3.0:1789518160.054227:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+42:2342:x1876445617014912:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518160.054245:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518160.054252:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7819e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca07 expref: 42 pid: 5811 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.054276:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7819e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca07 expref: 42 pid: 5811 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.054302:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7819e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca07 expref: 42 pid: 5811 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.054320:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd8781100) 00010000:00010000:3.0:1789518160.054326:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c781a16 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.054347:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c781a16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.054356:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c781a16 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.054391:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518160.054454:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+41:2342:x1876445617014912:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 233us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518160.054462:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 78 00010000:00010000:0.0:1789518160.054755:0:8051:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c781a16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.054771:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c781a16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518160.054792:0:8051:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789518160.054983:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c781a0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca23 expref: 42 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.055001:0:8051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c781a16 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca23 expref: 41 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.055008:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd8781100) 00010000:00010000:0.0:1789518160.055011:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789518160.055013:0:8051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697e00, rc 0) 00000100:00100000:0.0:1789518160.055044:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+41:11549:x1876445617014784:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 8927us (9226us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1789518160.055052:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 200 00000100:00100000:1.0:1789518160.057255:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518160.057307:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617015168 00000100:00100000:3.0:1789518160.057319:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617015168 00000100:00100000:3.0:1789518160.057388:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 201 00000100:00100000:3.0:1789518160.057400:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+41:11549:x1876445617015168:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518160.057429:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518160.057433:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789518160.057461:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c781a16 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca23 expref: 41 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.057482:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd8781100) 00010000:00010000:3.0:1789518160.057494:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518160.057511:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781a24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfca2a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.057666:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c781a2b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.057680:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c781a2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.057710:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c781a2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518160.057723:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789518160.057872:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781a24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca2a expref: 43 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.057901:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c781a2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca2a expref: 42 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.057909:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd8781700) 00010000:00010000:3.0:1789518160.057913:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789518160.057916:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17a00, rc 0) 00000100:00100000:3.0:1789518160.057988:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+42:11549:x1876445617015168:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 590us (743us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1789518160.057996:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 201 00000100:00100000:1.0:1789518160.063166:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518160.063289:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617015296 00000100:00100000:3.0:1789518160.063301:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617015296 00000100:00100000:3.0:1789518160.063402:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 202 00000100:00100000:3.0:1789518160.063415:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+42:11549:x1876445617015296:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518160.063448:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518160.063472:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781a39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfca31 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.063553:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781a39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca31 expref: 43 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.063601:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781a39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca31 expref: 43 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.063652:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd8781700) 00010000:00010000:3.0:1789518160.063656:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518160.063661:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17800, rc 0) 00000100:00100000:3.0:1789518160.063734:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+43:11549:x1876445617015296:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 321us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518160.063742:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 202 00000100:00100000:1.0:1789518160.071086:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518160.071232:0:8784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617015424 00000100:00100000:2.0:1789518160.071245:0:8784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617015424 00000100:00100000:2.0:1789518160.071424:0:8784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 61 00000100:00100000:2.0:1789518160.071553:0:8784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+6:2343:x1876445617015424:12345-192.168.206.51@tcp:1:lfs.0 00010000:00010000:2.0:1789518160.071646:0:8784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c781a40 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.071671:0:8784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c7819fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca15 expref: 6 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.071681:0:8784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789518160.071686:0:8784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518160.071691:0:8784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c781a40 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.071746:0:8784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c7819fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca15 expref: 6 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.071779:0:8784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c7819fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca15 expref: 6 pid: 6647 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518160.071795:0:8784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8784:1876445627480192:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518160.071903:0:8784:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a43480 going to sleep for 11 seconds 00000100:00100000:2.0:1789518160.076041:0:8784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8784:1876445627480192:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518160.076072:0:8784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c781a40 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518160.076569:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518160.076789:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617015552 00000100:00100000:2.0:1789518160.076797:0:6655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617015552 00002000:00100000:2.0:1789518160.076916:0:6655:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff99ffedb2aa00 x1876445617015552/t0(0) o4->cfa1c47d-1425-4fe5-be2a-28ad5152a12d@192.168.206.51@tcp:561/0 lens 504/0 e 0 to 0 dl 1789518171 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518160.076926:0:6655:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffedb2aa00 with x1876445617015552 ext(0->8) 00010000:00010000:2.0:1789518160.076934:0:6655:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c7819fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca15 expref: 7 pid: 6647 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.076948:0:6655:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c7819fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca15 expref: 7 pid: 6647 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518160.076956:0:6655:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99ffedb2aa00 00000100:00100000:2.0:1789518160.077045:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:2.0:1789518160.077055:0:6655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:2343:x1876445617015552:12345-192.168.206.51@tcp:4:lfs.0 00000100:00100000:2.0:1789518160.077510:0:6655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+9:2343:x1876445617015552:12345-192.168.206.51@tcp:4:lfs.0 Request processed in 455us (943us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789518160.077518:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 3 00002000:00100000:2.0:1789518160.077525:0:6655:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff99ffedb2aa00 x1876445617015552/t4294967308(0) o4->cfa1c47d-1425-4fe5-be2a-28ad5152a12d@192.168.206.51@tcp:561/0 lens 504/448 e 0 to 0 dl 1789518171 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518160.077533:0:6655:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffedb2aa00 with x1876445617015552 ext(0->8) 00010000:00010000:2.0:1789518160.077538:0:6655:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c7819fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca15 expref: 9 pid: 6647 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.077563:0:6655:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c7819fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca15 expref: 9 pid: 6647 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518160.077574:0:6655:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99ffedb2aa00 00000100:00100000:1.0:1789518160.080325:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518160.081011:0:7597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617015680 00000100:00100000:0.0:1789518160.081025:0:7597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617015680 00010000:00010000:0.0:1789518160.081075:0:7597:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c7819fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca15 expref: 9 pid: 6647 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518160.081118:0:7597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 79 00000100:00100000:0.0:1789518160.081128:0:7597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+9:2342:x1876445617015680:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518160.081149:0:7597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789518160.081179:0:7597:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789518160.081182:0:7597:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789518160 00002000:00010000:0.0:1789518160.081201:0:7597:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789518160 00002000:00010000:0.0:1789518160.081203:0:7597:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789518160 00010000:00010000:0.0:1789518160.081212:0:7597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c7819fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca15 expref: 9 pid: 6647 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.081240:0:7597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c7819fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca15 expref: 9 pid: 6647 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.081273:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c7819fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca15 expref: 9 pid: 6647 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.081352:0:7597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518160.081358:0:7597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518160.081365:0:7597:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c781a40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.081377:0:7597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c781a40 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.081466:0:7597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518160.081474:0:8784:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c781a40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.081486:0:8784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c781a40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.081514:0:8784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c781a40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.081528:0:8784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c781a40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.081550:0:8784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c781a40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.081558:0:8784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518160.081563:0:8784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c781a40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.081572:0:8784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c781a40 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.081586:0:8784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c781a40 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.081594:0:8784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c781a40 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518160.081601:0:7597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+8:2342:x1876445617015680:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 473us (1299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518160.081609:0:7597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 79 00000100:00100000:2.0:1789518160.081682:0:8784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:2343:x1876445617015424:12345-192.168.206.51@tcp:1:lfs.0 Request processed in 10248us (10611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518160.081691:0:8784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 61 00000100:00100000:1.0:1789518160.083719:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518160.083937:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617015936 00000100:00100000:3.0:1789518160.083950:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617015936 00000100:00100000:3.0:1789518160.084009:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 56 00000100:00100000:3.0:1789518160.084019:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfa70050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+43:11549:x1876445617015936:12345-192.168.206.51@tcp:35:lfs.0 00000004:00010000:3.0:1789518160.084091:0:5815:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c781a2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca2a expref: 43 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789518160.084429:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1789518160.084511:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1789518160.084923:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1789518160.084990:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781a47 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.085007:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781a39 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca31 expref: 47 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.085017:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781a47 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.085079:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781a39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca31 expref: 47 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.085096:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781a39 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca31 expref: 47 pid: 5811 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518160.085112:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff69ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5815:1876445627480320:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518160.085212:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc8186240 going to sleep for 11 seconds 00000100:00100000:3.0:1789518160.087288:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff69ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5815:1876445627480320:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518160.087332:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781a47 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518160.088105:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518160.088215:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617016064 00000100:00100000:3.0:1789518160.088226:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617016064 00010000:00010000:3.0:1789518160.088975:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781a39 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca31 expref: 48 pid: 5811 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518160.089075:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:3.0:1789518160.089088:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+48:2342:x1876445617016064:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518160.089109:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518160.089117:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781a39 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca31 expref: 48 pid: 5811 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.089131:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781a39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca31 expref: 48 pid: 5811 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.089182:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781a39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca31 expref: 48 pid: 5811 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.089200:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd8781700) 00010000:00010000:3.0:1789518160.089206:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781a47 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.089217:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781a47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.089226:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781a47 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.089312:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518160.089393:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781a47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.089412:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781a47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518160.089424:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+47:2342:x1876445617016064:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 340us (1324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518160.089433:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 80 00000001:00080000:0.0:1789518160.089954:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1789518160.090232:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1789518160.090411:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4000e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1876445627480448:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789518160.090476:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518160.090569:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627480448 00000100:00100000:1.0:1789518160.090578:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627480448 00000100:00100000:1.0:1789518160.090655:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789518160.090666:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4003b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5815:x1876445627480448:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789518160.090933:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd81bf540 going to sleep for 11 seconds 00000100:00100000:1.0:1789518160.090941:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4003b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5815:x1876445627480448:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 276us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518160.090948:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789518160.090965:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4000e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1876445627480448:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789518160.091940:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1789518160.092025:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4000e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1876445627480576:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789518160.092065:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518160.092097:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd81bfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789518160.092356:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627480576 00000100:00100000:3.0:1789518160.092363:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627480576 00000100:00100000:3.0:1789518160.092468:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789518160.092478:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4001180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5815:x1876445627480576:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789518160.092750:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4001180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5815:x1876445627480576:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 272us (683us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789518160.092758:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789518160.092860:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4000e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1876445627480576:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789518160.092943:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1789518160.092984:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781a47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.092996:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781a47 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.093004:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781a47 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.093011:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518160.093016:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781a47 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.093024:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781a47 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.093059:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd8781700) 00010000:00010000:0.0:1789518160.093063:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789518160.093069:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781a47 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.093075:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781a47 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789518160.093325:0:5815:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789518160.093449:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1789518160.093464:0:5815:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 214089849210ns, next at 215089845650ns, rc = 0 00000001:00080000:0.0:1789518160.093471:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1789518160.093509:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd8781700) 00010000:00010000:0.0:1789518160.093513:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789518160.093521:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c781a2b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca2a expref: 51 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518160.093668:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfa70050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+50:11549:x1876445617015936:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 9649us (9957us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1789518160.093677:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 56 00000020:00080000:0.0:1789518160.093681:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789518160.095723:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518160.096029:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617016192 00000100:00100000:0.0:1789518160.096041:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617016192 00000100:00100000:0.0:1789518160.096130:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 203 00000100:00100000:0.0:1789518160.096141:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+50:11549:x1876445617016192:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518160.096169:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518160.096196:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c781a4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfca38 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.096299:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c781a4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca38 expref: 51 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.096317:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c781a4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca38 expref: 51 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.096339:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd2a17a00) 00010000:00010000:0.0:1789518160.096343:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518160.096348:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd000, rc 0) 00000100:00100000:0.0:1789518160.096419:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+51:11549:x1876445617016192:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 279us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518160.096426:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 203 00000100:00100000:1.0:1789518160.098933:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518160.099064:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617016448 00000100:00100000:2.0:1789518160.099075:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617016448 00000100:00100000:2.0:1789518160.099257:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00100000:2.0:1789518160.099270:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+51:11549:x1876445617016448:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:2.0:1789518160.099571:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+52:11549:x1876445617016448:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 303us (648us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1789518160.099598:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00100000:1.0:1789518160.142186:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518160.142358:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617016576 00000100:00100000:0.0:1789518160.142376:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617016576 00000100:00100000:0.0:1789518160.142527:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 204 00000100:00100000:0.0:1789518160.142542:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+52:11559:x1876445617016576:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:0.0:1789518160.142691:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c781a55 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.142712:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c781a55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.142725:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c781a55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.142744:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781a5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.142764:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781a5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.142772:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781a5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.142912:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c781a63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.142922:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c781a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.142929:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c781a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518160.142999:0:8051:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c781a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.143014:0:8051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c781a55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.143021:0:8051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c781a55 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.143029:0:8051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c781a55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.143036:0:8051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518160.143045:0:8051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c781a55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.143053:0:8051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c781a55 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.143074:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99ffc2fdc600) 00010000:00010000:0.0:1789518160.143077:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518160.143084:0:8051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c781a55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.143091:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c781a55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.143107:0:8051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781a5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.143114:0:8051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781a5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.143120:0:8051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781a5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.143126:0:8051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518160.143130:0:8051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781a5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.143136:0:8051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781a5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.143143:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99ffd2a17900) 00010000:00010000:0.0:1789518160.143145:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518160.143148:0:8051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781a5c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.143160:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781a5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.143191:0:8051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c781a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.143198:0:8051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c781a63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.143204:0:8051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c781a63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.143209:0:8051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bce00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518160.143213:0:8051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c781a63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.143219:0:8051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c781a63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.143227:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd2a17a00) 00010000:00010000:0.0:1789518160.143229:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518160.143233:0:8051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c781a63 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.143239:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c781a63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518160.143348:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+52:11559:x1876445617016576:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 808us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518160.143358:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 204 00000100:00100000:1.0:1789518160.172758:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518160.172862:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617016832 00000100:00100000:0.0:1789518160.172874:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617016832 00000100:00100000:0.0:1789518160.172959:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 205 00000100:00100000:0.0:1789518160.172987:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+52:11562:x1876445617016832:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518160.173014:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518160.173039:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c781a6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfca3f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.173146:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781a71 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.173164:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781a71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.173178:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781a71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.173195:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c781a78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.173203:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c781a78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.173210:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c781a78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.173372:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c781a7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.173381:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c781a7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.173389:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c781a7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518160.173412:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789518160.173527:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781a71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.173536:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781a71 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.173544:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781a71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.173551:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518160.173556:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781a71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.173564:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781a71 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.173577:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99ffc2fdc600) 00010000:00010000:0.0:1789518160.173580:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518160.173586:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781a71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.173593:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781a71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.173609:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c781a78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.173667:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c781a78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.173683:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c781a78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.173689:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518160.173693:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c781a78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.173699:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c781a78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.173708:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99ffd2a17900) 00010000:00010000:0.0:1789518160.173711:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518160.173714:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c781a78 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.173719:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c781a78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.173770:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c781a6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca3f expref: 55 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.173786:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c781a7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca3f expref: 54 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.173794:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd2a17a00) 00010000:00010000:0.0:1789518160.173796:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518160.173798:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd600, rc 0) 00000100:00100000:0.0:1789518160.173891:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+54:11562:x1876445617016832:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 897us (1137us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1789518160.173909:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 205 00000100:00100000:1.0:1789518160.179960:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518160.180076:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617016960 00000100:00100000:3.0:1789518160.180088:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617016960 00000100:00100000:3.0:1789518160.180158:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 206 00000100:00100000:3.0:1789518160.180169:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+54:11562:x1876445617016960:12345-192.168.206.51@tcp:54:lfs.0 00010000:00010000:3.0:1789518160.180270:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781a8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.180291:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781a8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.180305:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781a8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.180338:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781a8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.180346:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781a8d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.180354:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781a8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.180361:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518160.180367:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781a8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.180376:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781a8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.180390:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd2a17a00) 00010000:00010000:3.0:1789518160.180393:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789518160.180399:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781a8d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.180406:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781a8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518160.180515:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+54:11562:x1876445617016960:12345-192.168.206.51@tcp:54:lfs.0 Request processed in 347us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518160.180523:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 206 00000100:00100000:2.0:1789518160.183014:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518160.183067:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617017216 00000100:00100000:0.0:1789518160.183077:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617017216 00000100:00100000:0.0:1789518160.183130:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 58 00000100:00100000:0.0:1789518160.183141:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+54:11562:x1876445617017216:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:0.0:1789518160.183417:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+55:11562:x1876445617017216:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 276us (412us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1789518160.183426:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 58 00000100:00100000:3.0:1789518160.221389:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518160.221527:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617017472 00000100:00100000:0.0:1789518160.221541:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617017472 00000100:00100000:0.0:1789518160.221660:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 207 00000100:00100000:0.0:1789518160.221673:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff69ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+55:11572:x1876445617017472:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:0.0:1789518160.221705:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518160.221709:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789518160.221744:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c781a08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca1c expref: 55 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.221773:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99ffc2fdc600) 00010000:00010000:0.0:1789518160.221781:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518160.222162:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c781a94 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfca46 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.222327:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c781a9b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.222344:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c781a7f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca3f expref: 55 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.222362:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c781a9b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.222402:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c781a7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca3f expref: 55 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.222417:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c781a7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca3f expref: 55 pid: 5812 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518160.222432:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda79f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1876445627480704:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518160.222550:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd81bfb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789518160.224930:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda79f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1876445627480704:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518160.224968:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c781a9b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518160.225513:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518160.225667:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617017600 00000100:00100000:1.0:1789518160.225677:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617017600 00010000:00010000:1.0:1789518160.225722:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c781a7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca3f expref: 56 pid: 5812 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518160.225763:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:1.0:1789518160.225774:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff69c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+56:2342:x1876445617017600:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518160.225792:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518160.225799:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c781a7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca3f expref: 56 pid: 5812 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518160.225813:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c781a7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca3f expref: 56 pid: 5812 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518160.225841:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c781a7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca3f expref: 56 pid: 5812 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518160.225859:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd2a17a00) 00010000:00010000:1.0:1789518160.225864:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c781a9b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518160.225874:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c781a9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518160.225897:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c781a9b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518160.225963:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518160.226025:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff69c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+55:2342:x1876445617017600:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 252us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518160.226033:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 81 00010000:00010000:2.0:1789518160.226435:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c781a9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.226447:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c781a9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518160.226596:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789518160.226805:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c781a94 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca46 expref: 56 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.226826:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c781a9b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca46 expref: 55 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.226835:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd2a17a00) 00010000:00010000:2.0:1789518160.226838:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789518160.226841:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc200, rc 0) 00000100:00100000:2.0:1789518160.226902:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff69ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+55:11572:x1876445617017472:12345-192.168.206.51@tcp:101:bash.0 Request processed in 5232us (5528us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1789518160.226913:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 207 00000100:00100000:3.0:1789518160.229472:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518160.230242:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617017856 00000100:00100000:0.0:1789518160.230256:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617017856 00000100:00100000:0.0:1789518160.230371:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 208 00000100:00100000:0.0:1789518160.230384:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff69d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+55:11572:x1876445617017856:12345-192.168.206.51@tcp:36:bash.0 00010000:00010000:0.0:1789518160.230779:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c781aa9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.230803:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c781aa9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.230817:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c781aa9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789518160.230914:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1789518160.230946:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000541bc5df reply state 000000003c3a8e80 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c781aa9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518160.230958:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518160.231081:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff69d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+58:11572:x1876445617017856:12345-192.168.206.51@tcp:36:bash.0 Request processed in 698us (1631us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1789518160.231088:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 208 00000020:00080000:0.0:1789518160.231094:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789518160.233542:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c781aa9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.233563:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c781aa9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.233572:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c781aa9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.233579:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bdc00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518160.233585:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c781aa9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.233594:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c781aa9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518160.234254:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:3.0:1789518160.234366:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd2a17a00) 00010000:00010000:3.0:1789518160.234371:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518160.234379:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c781aa9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.234387:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c781aa9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518160.234538:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617017984 00000100:00100000:2.0:1789518160.234550:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617017984 00000100:00100000:2.0:1789518160.234702:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 209 00000100:00100000:2.0:1789518160.234715:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+57:11572:x1876445617017984:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1789518160.234745:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518160.234768:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c781ab0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfca4d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.234897:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781ab7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.234914:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c781a9b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca46 expref: 58 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.234923:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781ab7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.234963:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c781a9b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca46 expref: 58 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.234978:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c781a9b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca46 expref: 58 pid: 5812 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518160.234994:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a5ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1876445627480832:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518160.235101:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a43180 going to sleep for 11 seconds 00000100:00100000:1.0:1789518160.237964:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518160.238008:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617018112 00000100:00100000:0.0:1789518160.238022:0:5798:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617018112 00000100:00100000:2.0:1789518160.238051:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a5ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1876445627480832:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518160.238071:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c781a9b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca46 expref: 59 pid: 5812 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.238085:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781ab7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518160.238112:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 82 00000100:00100000:0.0:1789518160.238125:0:5798:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+59:2343:x1876445617018112:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518160.238143:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518160.238152:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c781a9b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca46 expref: 59 pid: 5812 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.238166:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c781a9b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca46 expref: 59 pid: 5812 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.238194:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c781a9b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca46 expref: 59 pid: 5812 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.238240:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd2a17a00) 00010000:00010000:0.0:1789518160.238247:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781ab7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.238258:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.238268:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781ab7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.238299:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518160.238338:0:5813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518160.238368:0:5798:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+58:2343:x1876445617018112:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 245us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518160.238376:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 82 00010000:00010000:2.0:1789518160.238399:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518160.238461:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789518160.238474:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518160.238502:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.238541:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c781ab0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca4d expref: 58 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.238651:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781ab7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca4d expref: 57 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.238662:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd2a17a00) 00010000:00010000:2.0:1789518160.238665:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518160.238669:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696200, rc 0) 00000100:00100000:2.0:1789518160.238716:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+57:11572:x1876445617017984:12345-192.168.206.51@tcp:101:bash.0 Request processed in 4004us (4470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518160.238726:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 209 00000100:00100000:1.0:1789518160.241425:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518160.241768:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617018368 00000100:00100000:3.0:1789518160.241782:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617018368 00000100:00100000:3.0:1789518160.241978:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 59 00000100:00100000:3.0:1789518160.241993:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+57:11572:x1876445617018368:12345-192.168.206.51@tcp:35:bash.0 00000100:00100000:3.0:1789518160.242359:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+58:11572:x1876445617018368:12345-192.168.206.51@tcp:35:bash.0 Request processed in 368us (945us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1789518160.242367:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 59 00000100:00100000:1.0:1789518160.289001:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518160.290672:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617018496 00000100:00100000:2.0:1789518160.290690:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617018496 00000100:00100000:2.0:1789518160.290783:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 210 00000100:00100000:2.0:1789518160.290796:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+58:11578:x1876445617018496:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518160.290828:0:8051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518160.290856:0:8051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c781abe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfca54 expref: -99 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.290949:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c781ac5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.290967:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c781ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.291003:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c781ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518160.291047:0:8051:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789518160.291051:0:8051:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518160.291071:0:8051:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c781ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.291101:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c781abe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca54 expref: 60 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.291124:0:8051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c781ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca54 expref: 59 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.292304:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99ffc2fdc600) 00010000:00010000:2.0:1789518160.292314:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518160.292320:0:8051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696800, rc 0) 00000100:00100000:2.0:1789518160.292422:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+59:11578:x1876445617018496:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1624us (3431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518160.292432:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 210 00000100:00100000:1.0:1789518160.295592:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518160.295709:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617018624 00000100:00100000:0.0:1789518160.295723:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617018624 00000100:00100000:0.0:1789518160.295794:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 211 00000100:00100000:0.0:1789518160.295807:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+59:11578:x1876445617018624:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518160.295831:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518160.295857:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c781acc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfca5b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.295948:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781ad3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.295965:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781ad3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.295977:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781ad3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.296005:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c781ada lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.296013:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c781ada lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.296019:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c781ada lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.296131:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c781ae1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.296139:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c781ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.296146:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c781ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518160.296188:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789518160.296193:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518160.296216:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c781ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.296230:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c781ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.296239:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781ad3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.296245:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781ad3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.296263:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781ad3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.296270:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518160.296274:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781ad3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.296296:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781ad3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.296309:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99ffc2fdc600) 00010000:00010000:0.0:1789518160.296313:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518160.296318:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781ad3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.296325:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781ad3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.296341:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c781ada lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.296348:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c781ada lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.296354:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c781ada lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.296359:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bca00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518160.296362:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c781ada lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.296377:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c781ada lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.296385:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99ffd2a17900) 00010000:00010000:0.0:1789518160.296388:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518160.296391:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c781ada lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.296396:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c781ada lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.296431:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c781acc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca5b expref: 61 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.296445:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c781ae1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca5b expref: 60 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.296452:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd2a17a00) 00010000:00010000:0.0:1789518160.296454:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518160.296470:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bda00, rc 0) 00000100:00100000:0.0:1789518160.296557:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+60:11578:x1876445617018624:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 753us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518160.296565:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 211 00000100:00100000:3.0:1789518160.302265:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518160.302382:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518160.302480:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617018752 00000100:00100000:1.0:1789518160.302493:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617018752 00000100:00100000:0.0:1789518160.302566:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617019008 00000100:00100000:0.0:1789518160.302573:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617019008 00000100:00100000:1.0:1789518160.302579:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:1.0:1789518160.302593:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff69fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+61:2343:x1876445617018752:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518160.302631:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789518160.302646:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 212 00000100:00100000:0.0:1789518160.302658:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff69dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+61:11578:x1876445617019008:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518160.302663:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c781ae1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca5b expref: 61 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518160.302687:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd2a17a00) 00010000:00010000:1.0:1789518160.302696:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518160.302713:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518160.302733:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c781ae8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfca62 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518160.302769:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff69fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+61:2343:x1876445617018752:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 180us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518160.302778:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00010000:00010000:0.0:1789518160.302846:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c781aef lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.302863:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781ab7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca4d expref: 60 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.302873:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c781aef lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.302942:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781ab7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca4d expref: 60 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518160.302957:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781ab7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca4d expref: 60 pid: 5813 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518160.302974:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe62680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1876445627480960:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518160.303053:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd81bf0c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789518160.306786:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518160.307379:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe62680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1876445627480960:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518160.307419:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c781aef lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518160.308294:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518160.308552:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617019136 00000100:00100000:1.0:1789518160.308563:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617019136 00010000:00010000:1.0:1789518160.308608:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781ab7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca4d expref: 61 pid: 5813 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518160.308837:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 83 00000100:00100000:1.0:1789518160.308849:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc81d2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+61:2342:x1876445617019136:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518160.308868:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518160.308875:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781ab7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca4d expref: 61 pid: 5813 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518160.308901:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781ab7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca4d expref: 61 pid: 5813 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518160.308931:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781ab7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca4d expref: 61 pid: 5813 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518160.308949:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd2a17a00) 00010000:00010000:1.0:1789518160.308955:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c781aef lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518160.308966:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c781aef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518160.308975:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c781aef lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518160.309011:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518160.309081:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc81d2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+60:2342:x1876445617019136:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 234us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518160.309088:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 83 00010000:00010000:3.0:1789518160.309408:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c781aef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.309417:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c781aef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518160.309447:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789518160.309680:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c781ae8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca62 expref: 61 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.309699:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c781aef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca62 expref: 60 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.309706:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd2a17a00) 00010000:00010000:3.0:1789518160.309708:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789518160.309711:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc000, rc 0) 00000100:00100000:3.0:1789518160.309748:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff69dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+60:11578:x1876445617019008:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 7094us (7366us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1789518160.309767:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 212 00000100:00100000:3.0:1789518160.312020:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518160.312113:0:7597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617019392 00000100:00100000:2.0:1789518160.312125:0:7597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617019392 00000100:00100000:2.0:1789518160.312211:0:7597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:2.0:1789518160.312223:0:7597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff69d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+60:11578:x1876445617019392:12345-192.168.206.51@tcp:103:lfs.0 00010000:00010000:2.0:1789518160.312241:0:7597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518160.312268:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c781a4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca38 expref: 60 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.312311:0:7597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd2a17a00) 00010000:00010000:2.0:1789518160.312317:0:7597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518160.312388:0:7597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff69d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+59:11578:x1876445617019392:12345-192.168.206.51@tcp:103:lfs.0 Request processed in 166us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518160.312396:0:7597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:2.0:1789518160.314160:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518160.314267:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617019520 00000100:00100000:3.0:1789518160.314278:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617019520 00000100:00100000:3.0:1789518160.314338:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 213 00000100:00100000:3.0:1789518160.314349:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+59:11578:x1876445617019520:12345-192.168.206.51@tcp:58:lfs.0 00010000:00010000:3.0:1789518160.314470:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781afd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.314490:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781afd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518160.314504:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781afd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789518160.314928:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1789518160.315133:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+59:11578:x1876445617019520:12345-192.168.206.51@tcp:58:lfs.0 Request processed in 785us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518160.315142:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 213 00000100:00100000:3.0:1789518160.316858:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518160.316919:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617019648 00000100:00100000:2.0:1789518160.316930:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617019648 00000100:00100000:2.0:1789518160.317186:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 214 00000100:00100000:2.0:1789518160.317201:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff69c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+59:11578:x1876445617019648:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518160.317227:0:8051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518160.317253:0:8051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c781b04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfca69 expref: -99 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.317318:0:8051:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781afd lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.317330:0:8051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c781b04 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca69 expref: 60 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.317352:0:8051:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781afd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.317367:0:8051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c781b04 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca69 expref: 60 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.317383:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd2a17a00) 00010000:00010000:2.0:1789518160.317415:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518160.317420:0:8051:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c781b04 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca69 expref: 60 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518160.317429:0:8051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697400, rc 0) 00000100:00100000:2.0:1789518160.317497:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff69c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+60:11578:x1876445617019648:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 300us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518160.317504:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 214 00010000:00010000:2.0:1789518161.330815:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789518161.331008:0:11633:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789518161.331016:0:11633:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518161.331061:0:11633:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1789518161.331085:0:11633:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789518161.331254:0:11633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe62680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11633:1876445627481088:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789518161.331465:0:11633:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd81bfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789518161.339315:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518161.339673:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617019776 00000100:00100000:2.0:1789518161.339688:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617019776 00000100:00100000:2.0:1789518161.339770:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 215 00000100:00100000:0.0:1789518161.339779:0:11633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe62680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11633:1876445627481088:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789518161.339785:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff69fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+61:11579:x1876445617019776:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789518161.339828:0:5812:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789518161.339976:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff69fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+60:11579:x1876445617019776:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 195us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518161.339984:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 215 00000100:00100000:1.0:1789518161.347289:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518161.347410:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617019904 00000100:00100000:3.0:1789518161.347422:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617019904 00000100:00100000:3.0:1789518161.347539:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 216 00000100:00100000:3.0:1789518161.347550:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+60:11579:x1876445617019904:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789518161.347681:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c781b0b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.347716:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c781b0b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.347729:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c781b0b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.347748:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781b12 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.347754:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781b12 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.347760:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781b12 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.347785:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781b19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.347793:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781b19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.347799:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781b19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518161.347858:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789518161.347863:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518161.347889:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781b19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.347901:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c781b0b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.347919:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c781b0b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.347926:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c781b0b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.347932:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518161.347937:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c781b0b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.347945:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c781b0b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.347958:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffc2ad3d00) 00010000:00010000:3.0:1789518161.347961:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518161.347967:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c781b0b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.347973:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c781b0b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.347987:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781b12 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.347992:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781b12 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.347998:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781b12 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.348003:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518161.348011:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781b12 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.348017:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781b12 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.348024:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff99ffd8781100) 00010000:00010000:3.0:1789518161.348027:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518161.348030:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781b12 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.348036:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781b12 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.348051:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781b19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.348057:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781b19 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.348063:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781b19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.348068:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518161.348071:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781b19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.348076:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781b19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.348082:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd2a17a00) 00010000:00010000:3.0:1789518161.348085:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518161.348092:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781b19 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.348098:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781b19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518161.348189:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+60:11579:x1876445617019904:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 Request processed in 640us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518161.348197:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 216 00000100:00100000:1.0:1789518161.351390:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518161.351497:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617020160 00000100:00100000:2.0:1789518161.351510:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617020160 00000100:00100000:2.0:1789518161.351581:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 217 00000100:00100000:2.0:1789518161.351594:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+60:11579:x1876445617020160:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518161.351815:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518161.351843:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781b20 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfca70 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.351972:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781b27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.352008:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781b27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.352022:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781b27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518161.352036:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789518161.352161:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781b27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.352169:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781b27 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.352176:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781b27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.352183:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518161.352188:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781b27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.352197:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781b27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.352211:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd2a17a00) 00010000:00010000:2.0:1789518161.352214:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789518161.352220:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781b27 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.352226:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781b27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.352272:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781b20 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca70 expref: 62 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.352288:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffc2ad3d00) 00010000:00010000:2.0:1789518161.352291:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789518161.352295:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781b20 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca70 expref: 62 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.352304:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696200, rc 0) 00000100:00100000:2.0:1789518161.352382:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+61:11579:x1876445617020160:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 791us (1005us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1789518161.352390:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 217 00000100:00100000:0.0:1789518161.355180:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518161.355266:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617020288 00000100:00100000:2.0:1789518161.355279:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617020288 00000100:00100000:2.0:1789518161.355355:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 218 00000100:00100000:2.0:1789518161.355368:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+61:11579:x1876445617020288:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789518161.355420:0:8051:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789518161.355568:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+61:11579:x1876445617020288:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 202us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518161.355577:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 218 00000100:00100000:1.0:1789518161.360182:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518161.360313:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617020544 00000100:00100000:3.0:1789518161.360325:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617020544 00000100:00100000:3.0:1789518161.360400:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 219 00000100:00100000:3.0:1789518161.360411:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+61:11579:x1876445617020544:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518161.360436:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518161.360440:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789518161.360471:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c781ac5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca54 expref: 61 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.360492:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99ffc2fdc600) 00010000:00010000:3.0:1789518161.360498:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518161.360513:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781b35 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfca77 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789518161.361382:0:5813:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:3.0:1789518161.361639:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781b3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.361657:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781b3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.361688:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781b3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.361747:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c781b35 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca77 expref: 63 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.361763:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781b3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca77 expref: 62 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.361772:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99ffd8781100) 00010000:00010000:3.0:1789518161.361775:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518161.361777:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16e00, rc 0) 00000100:00100000:3.0:1789518161.361918:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+62:11579:x1876445617020544:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1508us (1750us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1789518161.361927:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 219 00000100:00100000:1.0:1789518161.372190:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518161.373135:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617020800 00000100:00100000:2.0:1789518161.373149:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617020800 00000100:00100000:2.0:1789518161.373228:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 220 00000100:00100000:2.0:1789518161.373239:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+62:11579:x1876445617020800:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789518161.373310:0:8051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518161.373343:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c781b3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca77 expref: 62 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.373390:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99ffd8781100) 00010000:00010000:2.0:1789518161.373406:0:8051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518161.373434:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781b4a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.373451:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781b4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.373462:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781b4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.373703:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781b51 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xf20819a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.373724:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781b51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf20819a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.373737:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781b51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf20819a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.373807:0:8051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781b4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.373814:0:8051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781b4a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.373820:0:8051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781b4a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.373826:0:8051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518161.373831:0:8051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781b4a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.373852:0:8051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781b4a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.373864:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99ffc2fdc600) 00010000:00010000:2.0:1789518161.373867:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518161.373872:0:8051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781b4a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.373890:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781b4a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.373905:0:8051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781b51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf20819a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.373912:0:8051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781b51 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf20819a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.373918:0:8051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781b51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf20819a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.373924:0:8051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518161.373927:0:8051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781b51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf20819a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.373932:0:8051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781b51 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf20819a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.373939:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xf20819a9 (ffff99ffc2ad3000) 00010000:00010000:2.0:1789518161.373942:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518161.373945:0:8051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781b51 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf20819a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.373963:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781b51 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf20819a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518161.374058:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+61:11579:x1876445617020800:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 817us (1879us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789518161.374067:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 220 00000100:00100000:1.0:1789518161.378382:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518161.378481:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617020928 00000100:00100000:2.0:1789518161.378494:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617020928 00000100:00100000:2.0:1789518161.378563:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 221 00000100:00100000:2.0:1789518161.378575:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+61:11579:x1876445617020928:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518161.378600:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518161.378921:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c781b58 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfca7e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.378965:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781b5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.378981:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781b5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.378994:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781b5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.379113:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c781b58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca7e expref: 63 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.379133:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781b5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca7e expref: 62 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.379156:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99ffc2ad3600) 00010000:00010000:2.0:1789518161.379159:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789518161.379162:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696e00, rc 0) 00000100:00100000:2.0:1789518161.379237:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+62:11579:x1876445617020928:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 665us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518161.379246:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 221 00000100:00100000:3.0:1789518161.383135:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518161.383301:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617021184 00000100:00100000:0.0:1789518161.383314:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617021184 00000100:00100000:0.0:1789518161.383381:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 222 00000100:00100000:0.0:1789518161.383394:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+62:11579:x1876445617021184:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789518161.383502:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c781b66 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.383524:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c781b66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.383538:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c781b66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789518161.383911:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:0.0:1789518161.383923:0:5811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 215380308453ns, next at 216380305113ns, rc = 0 00000004:00010000:0.0:1789518161.384035:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002d1a3bea reply state 0000000066beabd7 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c781b66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518161.384046:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518161.384158:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+64:11579:x1876445617021184:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 766us (1039us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1789518161.384167:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 222 00010000:00010000:2.0:1789518161.387512:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c781b66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.387534:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c781b66 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.387543:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c781b66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.387550:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bca00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518161.387556:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c781b66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.387566:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c781b66 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.387586:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99ffc2ad3600) 00010000:00010000:2.0:1789518161.387590:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789518161.387595:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c781b66 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.387601:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c781b66 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518161.389656:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518161.389832:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617021312 00000100:00100000:2.0:1789518161.389845:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617021312 00000100:00100000:2.0:1789518161.389915:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 223 00000100:00100000:2.0:1789518161.389927:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+63:11579:x1876445617021312:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518161.389957:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518161.389982:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781b6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfca85 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.390052:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781b6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca85 expref: 64 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.390069:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781b6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca85 expref: 64 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.390092:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99ffc2ad3600) 00010000:00010000:2.0:1789518161.390096:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518161.390100:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697600, rc 0) 00000100:00100000:2.0:1789518161.390460:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+64:11579:x1876445617021312:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 533us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518161.390469:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 223 00000100:00100000:1.0:1789518161.395984:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518161.396807:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617021440 00000100:00100000:2.0:1789518161.396821:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617021440 00000100:00100000:2.0:1789518161.396920:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 62 00000100:00080000:0.0:1789518161.396924:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518161.396933:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+9:2342:x1876445617021440:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789518161.397297:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+10:2342:x1876445617021440:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 366us (1324us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789518161.397312:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 62 00000100:00100000:1.0:1789518161.400729:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518161.400806:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617021696 00000100:00100000:0.0:1789518161.400818:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617021696 00000100:00100000:0.0:1789518161.400893:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 60 00000100:00100000:0.0:1789518161.400905:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+64:11579:x1876445617021696:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789518161.401192:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+65:11579:x1876445617021696:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 289us (477us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1789518161.401201:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 60 00000100:00100000:3.0:1789518161.407412:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518161.407685:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617021952 00000100:00100000:0.0:1789518161.407698:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617021952 00000100:00100000:0.0:1789518161.407768:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 224 00000100:00100000:0.0:1789518161.407779:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+65:11579:x1876445617021952:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789518161.407988:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+65:11579:x1876445617021952:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 210us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518161.407996:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 224 00000100:00100000:1.0:1789518161.410348:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518161.410587:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617022080 00000100:00100000:0.0:1789518161.410599:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617022080 00000100:00100000:0.0:1789518161.410708:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 225 00000100:00100000:0.0:1789518161.410722:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+65:11579:x1876445617022080:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518161.410747:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518161.410773:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781b74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfca8c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.410979:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781b7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.410996:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781b7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.411046:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781b7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518161.411090:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518161.411110:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781b7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.411139:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781b74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca8c expref: 67 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.411160:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781b7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca8c expref: 66 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.411169:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99ffc2ad3600) 00010000:00010000:0.0:1789518161.411172:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789518161.411177:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bde00, rc 0) 00000100:00100000:0.0:1789518161.411295:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+66:11579:x1876445617022080:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 577us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518161.411303:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 225 00000100:00100000:1.0:1789518161.418199:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518161.418286:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617022208 00000100:00100000:0.0:1789518161.418299:0:6649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617022208 00000100:00100000:0.0:1789518161.418373:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00100000:0.0:1789518161.418384:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+10:2343:x1876445617022208:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518161.418408:0:6649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518161.418444:0:6649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b635cb49/0x631fd8698c781b82 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfca93 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518161.418501:0:6649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa9e152, blocks: 0x1 00010000:00010000:0.0:1789518161.418527:0:6649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=215s v=(0 0) 00010000:00010000:0.0:1789518161.418532:0:6649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518161.418542:0:6649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b635cb49/0x631fd8698c781b82 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca93 expref: 11 pid: 6649 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.418563:0:6649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b635cb49/0x631fd8698c781b82 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca93 expref: 11 pid: 6649 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.418577:0:6649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc400, rc 0) 00000100:00100000:0.0:1789518161.418688:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+11:2343:x1876445617022208:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 306us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518161.418697:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00100000:3.0:1789518161.421972:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518161.427208:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617022464 00000100:00100000:2.0:1789518161.427236:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617022464 00000100:00100000:2.0:1789518161.427333:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 226 00000100:00100000:2.0:1789518161.427347:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+66:11579:x1876445617022464:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789518161.427539:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+66:11579:x1876445617022464:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 194us (5580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518161.427548:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 226 00000100:00100000:1.0:1789518161.432178:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518161.432292:0:6647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617022592 00000100:00100000:3.0:1789518161.432307:0:6647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617022592 00000100:00100000:3.0:1789518161.432393:0:6647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 64 00000100:00100000:3.0:1789518161.432408:0:6647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+11:11579:x1876445617022592:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518161.432446:0:6647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518161.432753:0:6647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c781b89 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfca9a expref: -99 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.432977:0:6647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b635cb49/0x631fd8698c781b82 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca93 expref: 12 pid: 6649 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.432989:0:6647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518161.432994:0:6647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518161.433000:0:6647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c781b89 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca9a expref: 12 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.433045:0:6647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b635cb49/0x631fd8698c781b82 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca93 expref: 12 pid: 6649 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.433061:0:6647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b635cb49/0x631fd8698c781b82 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca93 expref: 12 pid: 6649 timeout: 315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518161.433079:0:6647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6647:1876445627481216:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518161.433266:0:6647:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc514aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789518161.440407:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518161.440777:0:6647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffc5f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6647:1876445627481216:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518161.440836:0:6647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c781b89 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca9a expref: 12 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.440864:0:6647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17400, rc 0) 00000100:00100000:3.0:1789518161.440966:0:6647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+12:11579:x1876445617022592:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 8560us (8805us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518161.440977:0:6647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 64 00000100:00100000:0.0:1789518161.443120:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617022720 00000100:00100000:0.0:1789518161.443140:0:5798:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617022720 00010000:00010000:0.0:1789518161.443210:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b635cb49/0x631fd8698c781b82 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca93 expref: 12 pid: 6649 timeout: 315 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518161.443254:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 84 00000100:00100000:0.0:1789518161.443263:0:5798:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+12:2342:x1876445617022720:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518161.443280:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518161.443306:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b635cb49/0x631fd8698c781b82 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca93 expref: 12 pid: 6649 timeout: 315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.443348:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b635cb49/0x631fd8698c781b82 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca93 expref: 12 pid: 6649 timeout: 315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.443375:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b635cb49/0x631fd8698c781b82 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca93 expref: 12 pid: 6649 timeout: 315 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.443396:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518161.443401:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518161.443410:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c781b89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca9a expref: 11 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.443421:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c781b89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca9a expref: 11 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.443481:0:5798:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c781b89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca9a expref: 11 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518161.443572:0:5798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe61f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5798:1876445627481344:192.168.206.51@tcp:105: 00000100:00100000:0.0:1789518161.443945:0:5798:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd81bf900 going to sleep for 11 seconds 00000100:00100000:1.0:1789518161.453384:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518161.453528:0:12527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617022848 00000100:00100000:3.0:1789518161.453545:0:12527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617022848 00002000:00100000:3.0:1789518161.453659:0:12527:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff99ffffe5aa00 x1876445617022848/t0(0) o4->cfa1c47d-1425-4fe5-be2a-28ad5152a12d@192.168.206.51@tcp:562/0 lens 504/0 e 0 to 0 dl 1789518172 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518161.453673:0:12527:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffffe5aa00 with x1876445617022848 ext(0->12) 00002000:00010000:3.0:1789518161.453681:0:12527:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffffe5aa00 00000100:00100000:3.0:1789518161.453728:0:12527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:3.0:1789518161.453740:0:12527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+12:2342:x1876445617022848:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789518161.455186:0:5798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe61f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5798:1876445627481344:192.168.206.51@tcp:105: 00010000:00010000:0.0:1789518161.455233:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518161.455322:0:5798:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+12:2342:x1876445617022720:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 12058us (14931us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518161.455333:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 84 00000100:00100000:2.0:1789518161.458708:0:12527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+13:2342:x1876445617022848:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 4954us (5323us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1789518161.458727:0:12527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00002000:00100000:2.0:1789518161.458744:0:12527:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff99ffffe5aa00 x1876445617022848/t4294967320(0) o4->cfa1c47d-1425-4fe5-be2a-28ad5152a12d@192.168.206.51@tcp:562/0 lens 504/448 e 0 to 0 dl 1789518172 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518161.458756:0:12527:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffffe5aa00 with x1876445617022848 ext(0->12) 00002000:00010000:2.0:1789518161.458764:0:12527:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffffe5aa00 00000100:00100000:1.0:1789518161.464677:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518161.466947:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617022976 00000100:00100000:2.0:1789518161.466968:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617022976 00000100:00100000:2.0:1789518161.467090:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 227 00000100:00100000:2.0:1789518161.467102:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+66:11579:x1876445617022976:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789518161.500721:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1789518161.500744:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:1.0:1789518161.500779:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:1.0:1789518161.500809:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99ffd81bf540 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1789518161.500814:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffc777e000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99ffd81bfa80 00000020:00080000:1.0:1789518161.500817:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffc777e900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99fffffba000 00000020:00080000:1.0:1789518161.500837:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99ffffbb50c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1789518161.500839:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffd8487e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99ffffbb59c0 00000020:00080000:1.0:1789518161.500841:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffd8487100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99fff7a10800 00000004:00080000:1.0:1789518161.500861:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000100:00100000:3.0:1789518161.501064:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+20:11579:x1876445617022976:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 Request processed in 33957us (36626us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518161.501076:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 227 00000020:00080000:1.0:1789518161.501076:0:5844:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1789518161.501272:0:5844:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1789518161.501293:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627481472:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789518161.501543:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627481728:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789518161.501724:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518161.501863:0:8784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627481728 00000100:00100000:0.0:1789518161.501873:0:8784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627481728 00000100:00100000:0.0:1789518161.501955:0:8784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789518161.501966:0:8784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff64c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627481728:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789518161.502073:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518161.502119:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789518161.502127:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627481600:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789518161.502152:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518161.502188:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627481472 00000100:00080000:2.0:1789518161.502191:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518161.502194:0:6649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627481472 00000100:00100000:1.0:1789518161.502204:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627481600 00000100:00100000:1.0:1789518161.502210:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627481600 00000100:00080000:2.0:1789518161.502219:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518161.502224:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789518161.502234:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3280:x1876445627481472:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789518161.502251:0:6649:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:3.0:1789518161.502288:0:6649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa9e150, atime: 0x6aa9e150, ctime: 0x6aa9e150, blocks: 0x1 00010000:00010000:3.0:1789518161.502297:0:6649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8f0426e/0x631fd8698c781b90 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.502317:0:6649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=215s v=(0 0) 00010000:00010000:3.0:1789518161.502323:0:6649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518161.502331:0:6649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8f0426e/0x631fd8698c781b90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.502349:0:6649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8f0426e/0x631fd8698c781b90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518161.502350:0:8784:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789518161.502353:0:8784:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789518162 00002000:00010000:0.0:1789518161.502356:0:8784:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789518161.502359:0:8784:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789518162 -> 1789518162 00002000:00010000:0.0:1789518161.502361:0:8784:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00010000:00010000:3.0:1789518161.502367:0:6649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8f0426e/0x631fd8698c781b90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.502376:0:6649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8f0426e/0x631fd8698c781b90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.502403:0:6649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789518161.502409:0:8784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff64c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3282:x1876445627481728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 446us (686us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1789518161.502416:0:8784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789518161.502437:0:8784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789518161.502443:0:8784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3280:x1876445627481600:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789518161.502456:0:8784:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:0.0:1789518161.502467:0:8784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b635cb49/0x631fd8698c781b97 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.502482:0:8784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002e2fb305/0x631fd8698c78194b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9f2 expref: 12 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.502490:0:8784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789518161.502493:0:8784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518161.502496:0:8784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b635cb49/0x631fd8698c781b97 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.502525:0:8784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002e2fb305/0x631fd8698c78194b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9f2 expref: 12 pid: 6648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.502547:0:8784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002e2fb305/0x631fd8698c78194b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9f2 expref: 12 pid: 6648 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518161.502559:0:8784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe63100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8784:1876445627481856:192.168.206.51@tcp:104: 00000004:00080000:2.0:1789518161.502918:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99ffffe63800/2, rc 0, transno 4294967321 00000100:00100000:2.0:1789518161.502931:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627481728:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789518161.503033:0:8784:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd81bf000 going to sleep for 11 seconds 00000100:00100000:3.0:1789518161.503039:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3280:x1876445627481472:12345-0@lo:6:osp-syn-0-0.0 Request processed in 808us (967us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789518161.503047:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:2.0:1789518161.503578:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99ffffe5bb80/2, rc 0, transno 4294967310 00000100:00100000:2.0:1789518161.503586:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627481472:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1789518161.503658:0:7596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518161.503667:0:7596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8f0426e/0x631fd8698c781b90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518161.503678:0:7596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16e00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518161.503683:0:7596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8f0426e/0x631fd8698c781b90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518161.503694:0:7596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8f0426e/0x631fd8698c781b90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518161.503715:0:7596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8f0426e/0x631fd8698c781b90 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518161.503723:0:7596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8f0426e/0x631fd8698c781b90 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518161.503745:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518161.503747:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518161.503749:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518161.504228:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518161.504290:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617023104 00000100:00100000:2.0:1789518161.504298:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617023104 00000100:00100000:2.0:1789518161.504353:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 68 00000100:00100000:2.0:1789518161.504367:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+13:2343:x1876445617023104:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789518161.510055:0:8784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe63100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8784:1876445627481856:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518161.510096:0:8784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b635cb49/0x631fd8698c781b97 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518161.510490:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518161.510525:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617023232 00000100:00100000:0.0:1789518161.510533:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617023232 00010000:00010000:0.0:1789518161.510577:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002e2fb305/0x631fd8698c78194b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9f2 expref: 14 pid: 6648 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518161.510637:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 85 00000100:00100000:0.0:1789518161.510650:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+14:2343:x1876445617023232:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518161.510667:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518161.510674:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002e2fb305/0x631fd8698c78194b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9f2 expref: 14 pid: 6648 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.510690:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002e2fb305/0x631fd8698c78194b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9f2 expref: 14 pid: 6648 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.510801:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e2fb305/0x631fd8698c78194b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9f2 expref: 14 pid: 6648 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.510825:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518161.510830:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518161.510837:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b635cb49/0x631fd8698c781b97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.510851:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b635cb49/0x631fd8698c781b97 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.510894:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518161.510961:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+13:2343:x1876445617023232:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 314us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518161.510969:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 85 00010000:00010000:0.0:1789518161.511084:0:8784:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b635cb49/0x631fd8698c781b97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.511094:0:8784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b635cb49/0x631fd8698c781b97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.511174:0:8784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b635cb49/0x631fd8698c781b97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.511186:0:8784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b635cb49/0x631fd8698c781b97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.511220:0:8784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789518161.512951:0:8784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3280:x1876445627481600:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10497us (10787us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1789518161.512966:0:8784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:0.0:1789518161.513016:0:7595:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518161.513026:0:7595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b635cb49/0x631fd8698c781b97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.513037:0:7595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518161.513043:0:7595:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b635cb49/0x631fd8698c781b97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.513055:0:7595:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b635cb49/0x631fd8698c781b97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.513076:0:7595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b635cb49/0x631fd8698c781b97 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.513084:0:7595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b635cb49/0x631fd8698c781b97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.513336:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518161.513339:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518161.513341:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789518161.513397:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99ffffe61f80/2, rc 0, transno 4294967322 00000100:00100000:0.0:1789518161.513406:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627481600:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1789518161.548297:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:3.0:1789518161.548322:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:3.0:1789518161.548330:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:3.0:1789518161.548342:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:3.0:1789518161.548510:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:2343:x1876445617023104:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 Request processed in 44140us (44275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518161.548523:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 68 00000100:00100000:0.0:1789518161.551928:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518161.552094:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617023488 00000100:00100000:2.0:1789518161.552109:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617023488 00000100:00100000:2.0:1789518161.552182:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 228 00000100:00100000:2.0:1789518161.552194:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+20:11579:x1876445617023488:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789518161.552261:0:8051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518161.552294:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781b7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca8c expref: 20 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.552317:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99ffc2ad3600) 00010000:00010000:2.0:1789518161.552323:0:8051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518161.552359:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781b9e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.552375:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781b9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518161.552385:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781b9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518161.553165:0:8051:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ef668332 reply state 00000000bd7b1b85 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781b9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518161.553180:0:8051:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789518161.553323:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+21:11579:x1876445617023488:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 1129us (1540us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1789518161.553333:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 228 00000100:00100000:1.0:1789518161.555994:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:3.0:1789518161.556181:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781b9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.556220:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781b9e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.556229:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781b9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.556235:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518161.556241:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781b9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.556250:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781b9e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.556270:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99ffc2ad3600) 00010000:00010000:3.0:1789518161.556273:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518161.556279:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781b9e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.556285:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c781b9e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518161.556384:0:6647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617023616 00000100:00100000:0.0:1789518161.556401:0:6647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617023616 00000100:00100000:0.0:1789518161.556544:0:6647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 69 00000100:00100000:0.0:1789518161.556556:0:6647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:2343:x1876445617023616:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789518161.558028:0:6647:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789518161.558040:0:6647:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1789518162 -> 1789518160 00002000:00010000:0.0:1789518161.558043:0:6647:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789518160 00002000:00010000:0.0:1789518161.558045:0:6647:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789518162 -> 1789518160 00002000:00010000:0.0:1789518161.558048:0:6647:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789518161.558183:0:6647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+8:2343:x1876445617023616:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 1623us (2200us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1789518161.558193:0:6647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 69 00000100:00100000:1.0:1789518161.565956:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518161.566168:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617023872 00000100:00100000:0.0:1789518161.566182:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617023872 00000100:00100000:0.0:1789518161.566259:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 229 00000100:00100000:0.0:1789518161.566272:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+20:11579:x1876445617023872:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789518161.566438:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c781ba5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.566460:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781b5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca7e expref: 20 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.566471:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c781ba5 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.566513:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781b5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca7e expref: 20 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.566539:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781b5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca7e expref: 20 pid: 5812 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518161.566557:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe60700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1876445627481984:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518161.566867:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd81bf780 going to sleep for 11 seconds 00000100:00100000:2.0:1789518161.569952:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518161.570124:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe60700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1876445627481984:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518161.570165:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c781ba5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518161.570285:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617024000 00000100:00100000:1.0:1789518161.570295:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617024000 00010000:00010000:1.0:1789518161.570344:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781b5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca7e expref: 21 pid: 5812 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518161.570423:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 86 00000100:00100000:1.0:1789518161.570443:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff64f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+21:2343:x1876445617024000:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518161.570907:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518161.570918:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781b5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca7e expref: 21 pid: 5812 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518161.570932:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781b5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca7e expref: 21 pid: 5812 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518161.570959:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c781b5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca7e expref: 21 pid: 5812 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518161.570978:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99ffc2ad3600) 00010000:00010000:1.0:1789518161.570983:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c781ba5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518161.571006:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c781ba5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518161.571014:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c781ba5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518161.571045:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518161.571119:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff64f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+20:2343:x1876445617024000:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 677us (1180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518161.571145:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 86 00010000:00010000:0.0:1789518161.571268:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c781ba5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.571276:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c781ba5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.571310:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c781ba5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.571317:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c781ba5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.571324:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c781ba5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.571329:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518161.571334:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c781ba5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.571354:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c781ba5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.571363:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99ffc2ad3600) 00010000:00010000:0.0:1789518161.571366:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789518161.571370:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c781ba5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.571375:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c781ba5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518161.571424:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+19:11579:x1876445617023872:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 Request processed in 5156us (5484us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789518161.571446:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 229 00000100:00100000:1.0:1789518161.574921:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518161.575124:0:8784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617024128 00000100:00100000:0.0:1789518161.575137:0:8784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617024128 00000100:00100000:0.0:1789518161.575208:0:8784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 70 00000100:00100000:0.0:1789518161.575220:0:8784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+8:2343:x1876445617024128:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789518161.575277:0:8784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000042ecff79/0x631fd8698c781bac lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.575301:0:8784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c781b89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca9a expref: 8 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.575311:0:8784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518161.575316:0:8784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518161.575321:0:8784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042ecff79/0x631fd8698c781bac lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.575384:0:8784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c781b89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca9a expref: 8 pid: 6647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.575401:0:8784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c781b89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca9a expref: 8 pid: 6647 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518161.575418:0:8784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe60700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8784:1876445627482112:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518161.575855:0:8784:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd81bf780 going to sleep for 11 seconds 00000100:00100000:2.0:1789518161.581241:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518161.581361:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617024256 00000100:00100000:1.0:1789518161.581373:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617024256 00010000:00010000:1.0:1789518161.581422:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c781b89 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca9a expref: 9 pid: 6647 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518161.581474:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 87 00000100:00100000:1.0:1789518161.581485:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff633800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+9:2343:x1876445617024256:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518161.581503:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518161.581533:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c781b89 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca9a expref: 9 pid: 6647 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518161.581549:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c781b89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca9a expref: 9 pid: 6647 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518161.581581:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518161.581585:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518161.581592:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000042ecff79/0x631fd8698c781bac lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518161.581603:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042ecff79/0x631fd8698c781bac lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518161.581667:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518161.581731:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff633800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+9:2343:x1876445617024256:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 246us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518161.581747:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 87 00010000:00010000:0.0:1789518161.582088:0:8784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c781b89 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca9a expref: 8 pid: 6647 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518161.582294:0:8784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe60700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8784:1876445627482112:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518161.582379:0:8784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000042ecff79/0x631fd8698c781bac lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.582393:0:8784:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000042ecff79/0x631fd8698c781bac lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.582401:0:8784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042ecff79/0x631fd8698c781bac lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.582440:0:8784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000042ecff79/0x631fd8698c781bac lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.582917:0:8784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042ecff79/0x631fd8698c781bac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.582927:0:8784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042ecff79/0x631fd8698c781bac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.582935:0:8784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bcc00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518161.582940:0:8784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042ecff79/0x631fd8698c781bac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.582949:0:8784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042ecff79/0x631fd8698c781bac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.582974:0:8784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042ecff79/0x631fd8698c781bac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.582983:0:8784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042ecff79/0x631fd8698c781bac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518161.583349:0:8784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:2343:x1876445617024128:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 Request processed in 8128us (8438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518161.583361:0:8784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 70 00000100:00100000:2.0:1789518161.587888:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518161.587995:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617024512 00000100:00100000:0.0:1789518161.588008:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617024512 00000100:00100000:3.0:1789518161.588251:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 230 00000100:00100000:3.0:1789518161.588265:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+19:11579:x1876445617024512:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789518161.588368:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c781bb3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.588391:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c781bb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.588405:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c781bb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.588710:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c781bba lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.588722:0:8051:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781b6d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca85 expref: 20 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.588731:0:8051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c781bba lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.588774:0:8051:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781b6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca85 expref: 20 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.588789:0:8051:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781b6d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca85 expref: 20 pid: 5813 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518161.588806:0:8051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8051:1876445627482240:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518161.589013:0:8051:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc2af1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789518161.592412:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518161.592538:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617024640 00000100:00100000:0.0:1789518161.592564:0:5798:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617024640 00010000:00010000:0.0:1789518161.592643:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781b6d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca85 expref: 21 pid: 5813 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518161.592802:0:8051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffc5f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8051:1876445627482240:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518161.592830:0:8051:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c781bba lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518161.592939:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 88 00000100:00100000:0.0:1789518161.592951:0:5798:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+21:2342:x1876445617024640:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518161.592971:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518161.592992:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781b6d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca85 expref: 21 pid: 5813 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.593007:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781b6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca85 expref: 21 pid: 5813 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.593035:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c781b6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca85 expref: 21 pid: 5813 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.593436:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99ffc2ad3600) 00010000:00010000:0.0:1789518161.593443:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c781bba lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.593452:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c781bba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.593459:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c781bba lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.593483:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518161.593515:0:8051:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c781bba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.593522:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c781bba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518161.593555:0:5798:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+20:2342:x1876445617024640:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 607us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518161.593592:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 88 00000001:00080000:3.0:1789518161.593808:0:8051:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1789518161.594010:0:8051:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1789518161.594062:0:8051:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1789518161.595414:0:8051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8051:1876445627482368:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789518161.595730:0:8051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518161.595849:0:8051:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc2af10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518161.595964:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627482368 00000100:00100000:1.0:1789518161.595975:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627482368 00000100:00100000:1.0:1789518161.596108:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789518161.596121:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8051:x1876445627482368:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789518161.596228:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8051:x1876445627482368:12345-0@lo:1000:mdt00_003.0 Request processed in 110us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518161.596238:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789518161.596305:0:8051:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:3.0:1789518161.596312:0:8051:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:3.0:1789518161.596338:0:8051:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99ffffe63800, transno 4294967321 00000100:00100000:3.0:1789518161.596363:0:8051:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff99ffffe61f80 x1876445627481600/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789518177 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518161.596376:0:8051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffc5f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8051:1876445627482368:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1789518161.597411:0:8051:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1789518161.597572:0:8051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8051:1876445627482496:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789518161.597655:0:8051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518161.597689:0:8051:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc2af1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789518161.597895:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627482496 00000100:00100000:2.0:1789518161.597906:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627482496 00000100:00100000:2.0:1789518161.597962:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789518161.597972:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8051:x1876445627482496:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789518161.598277:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:8051:x1876445627482496:12345-0@lo:1000:mdt00_003.0 Request processed in 305us (620us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1789518161.598285:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789518161.598372:0:8051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8051:1876445627482496:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1789518161.598413:0:8051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c781bba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.598425:0:8051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c781bba lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.598500:0:8051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c781bba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.598507:0:8051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518161.598513:0:8051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c781bba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.598537:0:8051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c781bba lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.598555:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99ffc2ad3600) 00010000:00010000:3.0:1789518161.598558:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518161.598564:0:8051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c781bba lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.598570:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c781bba lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.598605:0:8051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781afd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.598642:0:8051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781afd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.598650:0:8051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781afd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.598655:0:8051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518161.598658:0:8051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781afd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.598664:0:8051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781afd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.598672:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd2a17a00) 00010000:00010000:3.0:1789518161.598674:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518161.598682:0:8051:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c781b04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca69 expref: 23 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.598709:0:8051:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c781b04 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca69 expref: 23 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.598719:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c781b04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca69 expref: 23 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.598751:0:8051:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c781b04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca69 expref: 23 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518161.598764:0:8051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8051:1876445627482624:192.168.206.51@tcp:105: 00000100:00100000:3.0:1789518161.598966:0:8051:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc2af1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789518161.602524:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518161.602702:0:8051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8051:1876445627482624:192.168.206.51@tcp:105: 00010000:00010000:3.0:1789518161.602740:0:8051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781afd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.602754:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c781afd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.602863:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781bc1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.602892:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781bc1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.602907:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781bc1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.602921:0:8051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781bc1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.602946:0:8051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781bc1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.602953:0:8051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781bc1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.602959:0:8051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518161.602964:0:8051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781bc1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.602972:0:8051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781bc1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.602984:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd2a17a00) 00010000:00010000:3.0:1789518161.602987:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518161.602990:0:8051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781bc1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.602996:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781bc1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.603009:0:8051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c781bb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.603014:0:8051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c781bb3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.603019:0:8051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c781bb3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.603023:0:8051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518161.603033:0:8051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c781bb3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.603039:0:8051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c781bb3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.603047:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd2a17a00) 00010000:00010000:3.0:1789518161.603050:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789518161.603052:0:8051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c781bb3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.603058:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c781bb3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518161.603524:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+23:11579:x1876445617024512:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 15257us (15655us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1789518161.603537:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 230 00000020:00080000:3.0:1789518161.603544:0:8051:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1789518161.604513:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617024768 00000100:00100000:0.0:1789518161.604528:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617024768 00000100:00100000:0.0:1789518161.604599:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 61 00000100:00100000:0.0:1789518161.604610:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+23:11578:x1876445617024768:12345-192.168.206.51@tcp:49:lfs.0 00000100:00100000:0.0:1789518161.604790:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+23:11578:x1876445617024768:12345-192.168.206.51@tcp:49:lfs.0 Request processed in 181us (2279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518161.604798:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 61 00000040:00080000:2.0:1789518161.607170:0:11633:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789518161.607187:0:11633:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518161.607927:0:11633:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1789518161.607943:0:11633:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789518161.612256:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518161.612364:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617025024 00000100:00100000:0.0:1789518161.612378:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617025024 00000100:00100000:0.0:1789518161.612549:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 62 00000100:00100000:0.0:1789518161.612562:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfa70450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+23:11579:x1876445617025024:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789518161.613486:0:5815:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789518161.613590:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1789518161.613671:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c781bc8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.613690:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c781bc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.613704:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c781bc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.613713:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c781bc8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.613720:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c781bc8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.613740:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c781bc8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.613765:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789518161.613906:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfa70450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+25:11579:x1876445617025024:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 1343us (1835us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1789518161.613917:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 62 00000020:00080000:0.0:1789518161.613923:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789518161.614044:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518161.614052:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c781bc8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518161.614060:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bcc00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518161.614065:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c781bc8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518161.614074:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c781bc8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518161.614089:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99ffd2a17900) 00010000:00010000:1.0:1789518161.614092:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789518161.614098:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c781bc8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518161.614105:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c781bc8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518161.614137:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518161.614140:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518161.614149:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518161.617340:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518161.617898:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617025280 00000100:00100000:3.0:1789518161.617913:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617025280 00000100:00100000:2.0:1789518161.619423:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 231 00000100:00100000:2.0:1789518161.619804:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+25:11578:x1876445617025280:12345-192.168.206.51@tcp:58:lfs.0 00000040:00080000:2.0:1789518161.620253:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1789518161.620431:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+25:11578:x1876445617025280:12345-192.168.206.51@tcp:58:lfs.0 Request processed in 635us (3102us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518161.620442:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 231 00000100:00100000:2.0:1789518161.651322:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518161.651495:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617025408 00000100:00100000:0.0:1789518161.651508:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617025408 00000100:00100000:0.0:1789518161.651589:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 232 00000100:00100000:0.0:1789518161.651656:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+25:11581:x1876445617025408:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518161.651690:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518161.651717:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c781bcf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcaa1 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.651800:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c781bd6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.651818:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c781bd6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.651832:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c781bd6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.651849:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781bdd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.651856:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781bdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.651893:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781bdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.652227:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781be4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.652240:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c781aef lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca62 expref: 26 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.652250:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781be4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.652294:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c781aef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca62 expref: 26 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518161.652311:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c781aef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca62 expref: 26 pid: 5811 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518161.652328:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe63800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1876445627482752:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518161.652467:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd81bf3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518161.657045:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe63800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1876445627482752:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518161.657090:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781be4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518161.660096:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518161.660215:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617025664 00000100:00100000:3.0:1789518161.660227:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617025664 00000100:00100000:3.0:1789518161.660338:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00100000:3.0:1789518161.660350:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+27:5577:x1876445617025664:12345-192.168.206.51@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789518161.660901:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+28:5577:x1876445617025664:12345-192.168.206.51@tcp:35:ldlm_bl.0 Request processed in 551us (816us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1789518161.660931:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00100000:0.0:1789518161.669446:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518161.669580:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617025792 00000100:00100000:1.0:1789518161.669593:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617025792 00010000:00010000:1.0:1789518161.669907:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c781aef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca62 expref: 28 pid: 5811 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518161.670873:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 89 00000100:00100000:1.0:1789518161.670906:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc81d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+28:2342:x1876445617025792:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518161.670929:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518161.670941:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c781aef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca62 expref: 28 pid: 5811 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518161.670959:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c781aef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca62 expref: 28 pid: 5811 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518161.670989:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c781aef lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca62 expref: 28 pid: 5811 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518161.671010:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd2a17a00) 00010000:00010000:1.0:1789518161.671016:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781be4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518161.671027:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781be4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518161.671037:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781be4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518161.671077:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518161.671186:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc81d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+27:2342:x1876445617025792:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 291us (1754us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518161.671194:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 89 00010000:00010000:3.0:1789518161.671508:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781be4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.671518:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781be4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518161.671571:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789518161.671576:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518161.671600:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781be4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.671634:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781be4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.671647:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c781bd6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.671654:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c781bd6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.671673:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c781bd6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.671680:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bcc00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518161.671685:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c781bd6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.671693:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c781bd6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.671705:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99ffc2fdc600) 00010000:00010000:3.0:1789518161.671718:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518161.671724:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c781bd6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.671731:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c781bd6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.671746:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781bdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.671752:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781bdd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.671758:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781bdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.671764:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bde00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518161.671766:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781bdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.671772:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781bdd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.671780:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99ffd2a17f00) 00010000:00010000:3.0:1789518161.671783:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518161.671786:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781bdd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.671791:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c781bdd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.671835:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c781bcf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcaa1 expref: 27 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.671864:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781be4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcaa1 expref: 26 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518161.671871:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd2a17a00) 00010000:00010000:3.0:1789518161.671887:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518161.671890:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd200, rc 0) 00000100:00100000:3.0:1789518161.671948:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+26:11581:x1876445617025408:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 20348us (20638us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518161.671956:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 232 00000040:00080000:3.0:1789518162.256832:0:12565:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789518162.256841:0:12565:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518162.256910:0:12565:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789518162.256915:0:12565:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789518162.356051:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518162.547508:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627483264:0@lo:400:kworker.0 00000100:00100000:0.0:1789518162.547521:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627483008:0@lo:400:kworker.0 00000100:00100000:1.0:1789518162.547582:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518162.547583:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518162.547661:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789518162.547669:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:824c8f07-28fa-48fd-81af-173b194570e6:3282:1876445627482880:0@lo:400:kworker.0 00000100:00100000:1.0:1789518162.547702:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518162.547731:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627483008 00000100:00100000:1.0:1789518162.547735:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627483392:0@lo:400:kworker.0 00000100:00100000:2.0:1789518162.547739:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627483008 00000100:00100000:1.0:1789518162.547765:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518162.547799:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627483136:0@lo:400:kworker.0 00000100:00100000:1.0:1789518162.547824:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518162.547833:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627483264 00000100:00100000:3.0:1789518162.547838:0:6649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627483264 00000100:00100000:3.0:1789518162.547994:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789518162.548004:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3282:x1876445627483264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518162.548058:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3282:x1876445627483264:12345-0@lo:400:kworker.0 Request processed in 57us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518162.548065:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789518162.548145:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627483520:0@lo:400:kworker.0 00000100:00100000:0.0:1789518162.548172:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518162.548203:0:6647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627483520 00000100:00100000:0.0:1789518162.548207:0:6647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627483520 00000100:00100000:0.0:1789518162.548248:0:6647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789518162.548254:0:6647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3280:x1876445627483520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518162.548288:0:6647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3280:x1876445627483520:12345-0@lo:400:kworker.0 Request processed in 34us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518162.548293:0:6647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789518162.548332:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627483520:0@lo:400:kworker.0 00000100:00100000:1.0:1789518162.548699:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627483648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518162.548726:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518162.548755:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627483648 00000100:00100000:1.0:1789518162.548759:0:6652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627483648 00000100:00100000:1.0:1789518162.548785:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789518162.548792:0:6652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1876445627483648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789518162.548805:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1789518162.548838:0:6652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1876445627483648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518162.548843:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789518162.548900:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627483648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518162.548901:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627483392 00000100:00100000:2.0:1789518162.548908:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627483392 00000100:00100000:1.0:1789518162.548936:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627482880 00000100:00100000:1.0:1789518162.548941:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627482880 00000100:00100000:2.0:1789518162.548942:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627483136 00000100:00100000:2.0:1789518162.548956:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627483136 00000100:00100000:1.0:1789518162.548981:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789518162.548988:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789518162.548993:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+19:3282:x1876445627482880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518162.549003:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627483008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518162.549029:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:824c8f07-28fa-48fd-81af-173b194570e6+19:3282:x1876445627482880:12345-0@lo:400:kworker.0 Request processed in 40us (1327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518162.549036:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789518162.549059:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627483008:12345-0@lo:400:kworker.0 Request processed in 59us (1478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518162.549066:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:1.0:1789518162.549079:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518162.549084:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789518162.549093:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876445627483392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518162.549106:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627483008:0@lo:400:kworker.0 00000100:00100000:2.0:1789518162.549131:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876445627483392:12345-0@lo:400:kworker.0 Request processed in 39us (1367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518162.549139:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789518162.549154:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:824c8f07-28fa-48fd-81af-173b194570e6:3282:1876445627482880:0@lo:400:kworker.0 00000100:00100000:2.0:1789518162.549159:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789518162.549169:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627483136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518162.549171:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627483392:0@lo:400:kworker.0 00000100:00100000:1.0:1789518162.549188:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627483264:0@lo:400:kworker.0 00000100:00100000:2.0:1789518162.549215:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627483136:12345-0@lo:400:kworker.0 Request processed in 48us (1389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518162.549222:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789518162.549252:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627483136:0@lo:400:kworker.0 00000040:00080000:2.0:1789518162.612525:0:11633:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789518162.612533:0:11633:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518162.612562:0:11633:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789518162.612571:0:11633:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789518162.612687:0:11633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7a300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11633:1876445627483776:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789518162.612834:0:11633:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffff76f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518162.617338:0:11633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7a300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11633:1876445627483776:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789518162.617491:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518162.617638:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617025920 00000100:00100000:2.0:1789518162.617645:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617025920 00000100:00100000:2.0:1789518162.617707:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 233 00000100:00100000:2.0:1789518162.617726:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+26:11593:x1876445617025920:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789518162.617754:0:5812:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789518162.617902:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+26:11593:x1876445617025920:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 176us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518162.617910:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 233 00000100:00080000:1.0:1789518162.617927:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518162.623686:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518162.623818:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617026176 00000100:00100000:3.0:1789518162.623826:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617026176 00000100:00100000:3.0:1789518162.623889:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 234 00000100:00100000:3.0:1789518162.623901:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+26:11593:x1876445617026176:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518162.623921:0:8051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518162.623958:0:8051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c781beb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcaa8 expref: -99 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518162.624048:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781bf2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518162.624062:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518162.624073:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518162.624084:0:8051:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789518162.624209:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c781beb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcaa8 expref: 29 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518162.624228:0:8051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781bf2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcaa8 expref: 28 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518162.624236:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd2a17a00) 00010000:00010000:3.0:1789518162.624239:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518162.624242:0:8051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16800, rc 0) 00000100:00100000:3.0:1789518162.624317:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+28:11593:x1876445617026176:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 409us (626us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1789518162.624325:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 234 00000100:00100000:0.0:1789518162.630187:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518162.630279:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617026304 00000100:00100000:0.0:1789518162.630295:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518162.630297:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617026304 00000100:00100000:3.0:1789518162.630388:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:2.0:1789518162.630400:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617026560 00000100:00100000:3.0:1789518162.630403:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+28:2343:x1876445617026304:12345-192.168.206.51@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789518162.630412:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617026560 00010000:00010000:3.0:1789518162.630458:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518162.630489:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781bf2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcaa8 expref: 29 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518162.630491:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 235 00000100:00100000:2.0:1789518162.630510:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+28:11593:x1876445617026560:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789518162.630518:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd2a17a00) 00010000:00010000:3.0:1789518162.630527:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518162.630584:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c781c00 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518162.630602:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c781c00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518162.630609:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+28:2343:x1876445617026304:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 207us (427us total) trans 0 rc 0/0 00010000:00010000:2.0:1789518162.630659:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c781c00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518162.630675:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 15 00010000:00010000:2.0:1789518162.634171:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c781c00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518162.634181:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c781c00 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518162.634189:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c781c00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518162.634230:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518162.634234:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c781c00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518162.634255:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c781c00 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518162.634271:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd2a17a00) 00010000:00010000:2.0:1789518162.634274:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789518162.634280:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c781c00 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518162.634286:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c781c00 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518162.634790:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+28:11593:x1876445617026560:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 4280us (4491us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1789518162.634803:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 235 00000040:00080000:1.0:1789518162.635076:0:11633:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789518162.635082:0:11633:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518162.636039:0:11633:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789518162.636052:0:11633:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789518162.638065:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518162.638235:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617026816 00000100:00100000:3.0:1789518162.638248:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617026816 00000100:00100000:3.0:1789518162.638326:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 64 00000100:00100000:3.0:1789518162.638339:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+28:11593:x1876445617026816:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789518162.638691:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+29:11593:x1876445617026816:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 353us (638us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1789518162.638700:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 64 00000001:00080000:2.0:1789518163.090552:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:2.0:1789518163.090567:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:2.0:1789518163.090573:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:1.0:1789518163.378740:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789518163.785523:0:12618:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789518163.785532:0:12618:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518163.785579:0:12618:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789518163.785585:0:12618:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789518163.890430:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518163.896057:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617027072 00000100:00100000:3.0:1789518163.896070:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617027072 00000100:00100000:3.0:1789518163.896215:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 236 00000100:00100000:3.0:1789518163.896225:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+29:11613:x1876445617027072:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518163.896249:0:8051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518163.896268:0:8051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781c07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcaaf expref: -99 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518163.896371:0:8051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c781c0e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518163.896386:0:8051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c781c0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518163.896397:0:8051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c781c0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8051 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518163.896408:0:8051:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789518163.896518:0:8051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c781c07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcaaf expref: 32 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518163.896533:0:8051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c781c0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcaaf expref: 31 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518163.896542:0:8051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd2a17a00) 00010000:00010000:3.0:1789518163.896545:0:8051:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789518163.896549:0:8051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16c00, rc 0) 00000100:00100000:3.0:1789518163.896604:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+31:11613:x1876445617027072:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 381us (6182us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1789518163.896630:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 236 00000100:00100000:1.0:1789518163.899155:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518163.899196:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617027200 00000100:00100000:1.0:1789518163.899204:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617027200 00000100:00100000:1.0:1789518163.899258:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 237 00000100:00100000:1.0:1789518163.899270:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+31:11613:x1876445617027200:12345-192.168.206.51@tcp:54:lfs.0 00010000:00010000:1.0:1789518163.899321:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c781c1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518163.899353:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c781c1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518163.899364:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c781c1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518163.899399:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c781c1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518163.899407:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c781c1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518163.899414:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c781c1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518163.899421:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518163.899425:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c781c1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518163.899433:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c781c1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518163.899445:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd2a17a00) 00010000:00010000:1.0:1789518163.899449:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789518163.899453:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c781c1c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518163.899460:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c781c1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518163.899531:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+31:11613:x1876445617027200:12345-192.168.206.51@tcp:54:lfs.0 Request processed in 263us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518163.899545:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 237 00000100:00100000:3.0:1789518163.965102:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518163.965198:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617027328 00000100:00100000:0.0:1789518163.965207:0:6649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617027328 00000100:00100000:0.0:1789518163.965333:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 71 00000100:00100000:0.0:1789518163.965344:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:2342:x1876445617027328:12345-192.168.206.51@tcp:101:cat.0 00010000:00010000:0.0:1789518163.965362:0:6649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518163.965383:0:6649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e16297d1/0x631fd8698c781c23 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcab6 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518163.965408:0:6649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa9e150, atime: 0x6aa9e150, ctime: 0x6aa9e150, blocks: 0xb 00010000:00010000:0.0:1789518163.965438:0:6649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=217s v=(0 0) 00010000:00010000:0.0:1789518163.965442:0:6649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518163.965450:0:6649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e16297d1/0x631fd8698c781c23 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcab6 expref: 8 pid: 6649 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518163.965484:0:6649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e16297d1/0x631fd8698c781c23 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcab6 expref: 8 pid: 6649 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518163.965496:0:6649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bce00, rc 0) 00000100:00080000:1.0:1789518163.965520:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518163.965549:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+8:2342:x1876445617027328:12345-192.168.206.51@tcp:101:cat.0 Request processed in 207us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518163.965556:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 71 00000100:00100000:1.0:1789518163.968861:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518163.968967:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617027456 00000100:00100000:3.0:1789518163.968975:0:6654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617027456 00002000:00100000:3.0:1789518163.969017:0:6654:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff99ffff69d500 x1876445617027456/t0(0) o3->cfa1c47d-1425-4fe5-be2a-28ad5152a12d@192.168.206.51@tcp:564/0 lens 488/0 e 0 to 0 dl 1789518174 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518163.969038:0:6654:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffff69d500 with x1876445617027456 ext(0->4095) 00002000:00010000:3.0:1789518163.969042:0:6654:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffff69d500 00000100:00100000:3.0:1789518163.969096:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:3.0:1789518163.969103:0:6654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff69d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+8:2343:x1876445617027456:12345-192.168.206.51@tcp:3:cat.0 00000100:00100000:3.0:1789518163.969248:0:6654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff69d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+8:2343:x1876445617027456:12345-192.168.206.51@tcp:3:cat.0 Request processed in 145us (394us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789518163.969253:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00002000:00100000:3.0:1789518163.969257:0:6654:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff99ffff69d500 x1876445617027456/t0(0) o3->cfa1c47d-1425-4fe5-be2a-28ad5152a12d@192.168.206.51@tcp:564/0 lens 488/4536 e 0 to 0 dl 1789518174 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518163.969262:0:6654:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffff69d500 with x1876445617027456 ext(0->4095) 00002000:00010000:3.0:1789518163.969265:0:6654:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffff69d500 00000100:00100000:1.0:1789518164.366066:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518164.366302:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518164.366360:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518164.366512:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617027840 00000100:00100000:3.0:1789518164.366530:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617027840 00000100:00100000:3.0:1789518164.366676:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 100 00000100:00100000:3.0:1789518164.366689:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2342:x1876445617027840:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518164.366805:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2342:x1876445617027840:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 118us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518164.366814:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 100 00000100:00080000:1.0:1789518164.367056:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518164.367107:0:8784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617027712 00000100:00100000:0.0:1789518164.367119:0:8784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617027712 00000100:00100000:0.0:1789518164.367391:0:8784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 61 00000100:00100000:0.0:1789518164.367402:0:8784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff64f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2343:x1876445617027712:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518164.367477:0:8784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff64f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2343:x1876445617027712:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 77us (1420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518164.367485:0:8784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 61 00000100:00080000:1.0:1789518164.367932:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518164.368507:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617027584 00000100:00100000:2.0:1789518164.368515:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617027584 00000100:00100000:2.0:1789518164.368559:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 272 00000100:00100000:2.0:1789518164.368579:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+13:2342:x1876445617027584:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518164.368750:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+13:2342:x1876445617027584:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 171us (2448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518164.368758:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 272 00010000:00010000:0.0:1789518164.403365:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518164.595849:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627483904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518164.595956:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518164.596293:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627483904 00000100:00100000:0.0:1789518164.596301:0:6652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627483904 00000100:00080000:3.0:1789518164.596361:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518164.596371:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789518164.596381:0:6652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627483904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518164.596411:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789518164.597022:0:6652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627483904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 641us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518164.597031:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789518164.597033:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1789518164.597041:0:3282:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fff7882a00, transno 4294967307 00000004:00080000:1.0:1789518164.597060:0:3282:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1789518164.597078:0:3282:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99ffffe5bb80, transno 4294967310 00000100:00100000:1.0:1789518164.597092:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627483904:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789518165.427797:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518166.450934:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518166.577932:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518166.578302:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617027968 00000100:00100000:1.0:1789518166.578312:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617027968 00000100:00100000:1.0:1789518166.578397:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 238 00000100:00100000:1.0:1789518166.578409:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+31:11259:x1876445617027968:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 00000100:00080000:3.0:1789518166.578480:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518166.578525:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+31:11259:x1876445617027968:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 Request processed in 119us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518166.578534:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 238 00000100:00100000:0.0:1789518166.584769:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518166.584876:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617028224 00000100:00100000:3.0:1789518166.584886:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617028224 00000100:00100000:3.0:1789518166.584962:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 65 00000100:00100000:3.0:1789518166.584972:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+31:11259:x1876445617028224:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789518166.585234:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+32:11259:x1876445617028224:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 263us (473us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1789518166.585242:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 65 00000001:00080000:1.0:1789518166.687064:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967514 is committed 00000020:00080000:1.0:1789518166.687084:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1789518166.687147:0:5844:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000020:00080000:3.0:1789518166.687160:0:5844:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:1.0:1789518166.687440:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000001:00080000:1.0:1789518166.687462:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1789518166.687491:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99ffc2af10c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1789518166.687496:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff420bf00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99ffc2af1900 00000020:00080000:1.0:1789518166.687500:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff420bb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99ffff547c00 00000020:00080000:3.0:1789518166.687537:0:5844:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1789518166.687810:0:5844:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:3.0:1789518166.688848:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:3.0:1789518166.688869:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:3.0:1789518166.688875:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00010000:00010000:1.0:1789518167.474808:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789518167.575783:0:12817:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 20:22:47 (1789518167) 00000100:00100000:1.0:1789518167.666778:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627484032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518167.666835:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518167.666912:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627484032 00000100:00100000:1.0:1789518167.666918:0:6652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627484032 00000100:00100000:1.0:1789518167.666967:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789518167.666976:0:6652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2974700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627484032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789518167.667005:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789518167.667047:0:6652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2974700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627484032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518167.667055:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1789518167.667076:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518167.667119:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1789518167.667126:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99ffffe61f80, transno 4294967322 00000004:00080000:0.0:1789518167.667144:0:3283:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1789518167.667182:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627484032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518167.667587:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:824c8f07-28fa-48fd-81af-173b194570e6:3280:1876445627484160:0@lo:400:kworker.0 00000100:00100000:1.0:1789518167.667645:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518167.667699:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627484160 00000100:00100000:1.0:1789518167.667704:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627484160 00000100:00100000:1.0:1789518167.667736:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789518167.667745:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+19:3280:x1876445627484160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518167.667780:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:824c8f07-28fa-48fd-81af-173b194570e6+19:3280:x1876445627484160:12345-0@lo:400:kworker.0 Request processed in 37us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518167.667786:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789518167.667819:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:824c8f07-28fa-48fd-81af-173b194570e6:3280:1876445627484160:0@lo:400:kworker.0 00000100:00100000:1.0:1789518167.667914:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876445627484288:0@lo:400:kworker.0 00000100:00100000:1.0:1789518167.667944:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518167.667965:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789518167.667971:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627484672:0@lo:400:kworker.0 00000100:00100000:1.0:1789518167.667989:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518167.668013:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627484288 00000100:00100000:1.0:1789518167.668016:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627484288 00000100:00100000:1.0:1789518167.668045:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627484672 00000100:00100000:1.0:1789518167.668047:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627484672 00000100:00100000:0.0:1789518167.668052:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627484416:0@lo:400:kworker.0 00000100:00100000:1.0:1789518167.668077:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789518167.668084:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876445627484288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518167.668108:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518167.668135:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789518167.668140:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876445627484288:12345-0@lo:400:kworker.0 Request processed in 55us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518167.668145:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627484544:0@lo:400:kworker.0 00000100:00100000:1.0:1789518167.668152:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789518167.668169:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627484416 00000100:00100000:1.0:1789518167.668173:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627484416 00000100:00100000:0.0:1789518167.668186:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518167.668203:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789518167.668212:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627484672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518167.668225:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627484544 00000100:00100000:0.0:1789518167.668231:0:6649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627484544 00000100:00100000:1.0:1789518167.668258:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627484672:12345-0@lo:400:kworker.0 Request processed in 47us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518167.668267:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789518167.668273:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789518167.668284:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627484544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518167.668290:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789518167.668301:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627484416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518167.668332:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627484544:12345-0@lo:400:kworker.0 Request processed in 50us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518167.668341:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789518167.668350:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627484416:12345-0@lo:400:kworker.0 Request processed in 50us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518167.668358:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:1.0:1789518167.668401:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789518167.668406:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518167.668429:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627484672:0@lo:400:kworker.0 00000100:00100000:1.0:1789518167.668443:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876445627484288:0@lo:400:kworker.0 00000100:00100000:0.0:1789518167.668505:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627484544:0@lo:400:kworker.0 00000100:00100000:0.0:1789518167.668518:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627484416:0@lo:400:kworker.0 00010000:00010000:1.0:1789518168.502338:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518168.703514:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518168.703792:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617028352 00000100:00100000:1.0:1789518168.703803:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617028352 00000100:00080000:0.0:1789518168.703882:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518168.703892:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 239 00000100:00100000:1.0:1789518168.703904:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e523f9d-cd98-44af-a94f-935bacbf145f+5:12277:x1876445617028352:12345-192.168.206.51@tcp:101:lsof.0 00010000:00010000:1.0:1789518168.703922:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518168.704015:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c781c2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcabd expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518168.704074:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c781c31 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518168.704088:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c781c31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518168.704109:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c781c31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518168.704150:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789518168.704154:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518168.704192:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c781c31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518168.704215:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c781c2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcabd expref: 7 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518168.704251:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c781c31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcabd expref: 6 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518168.704260:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2ad3f00) 00010000:00010000:1.0:1789518168.704262:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518168.704266:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f7e00, rc 0) 00000100:00100000:1.0:1789518168.704329:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e523f9d-cd98-44af-a94f-935bacbf145f+6:12277:x1876445617028352:12345-192.168.206.51@tcp:101:lsof.0 Request processed in 427us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518168.704336:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 239 00000100:00100000:1.0:1789518169.337132:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518169.337252:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617028608 00000100:00100000:2.0:1789518169.337274:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617028608 00000100:00100000:2.0:1789518169.337553:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 66 00000100:00100000:2.0:1789518169.337564:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+18:12278:x1876445617028608:12345-192.168.206.51@tcp:35:umount.0 00000100:00100000:2.0:1789518169.337905:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+19:12278:x1876445617028608:12345-192.168.206.51@tcp:35:umount.0 Request processed in 342us (780us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1789518169.337913:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 66 00000100:00080000:0.0:1789518169.338128:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518169.344659:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518169.344814:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617028864 00000100:00100000:2.0:1789518169.344824:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617028864 00000100:00100000:2.0:1789518169.345063:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 67 00000100:00100000:2.0:1789518169.345073:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+19:12278:x1876445617028864:12345-192.168.206.51@tcp:35:umount.0 00000100:00100000:2.0:1789518169.348203:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+20:12278:x1876445617028864:12345-192.168.206.51@tcp:35:umount.0 Request processed in 1492us (1912us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1789518169.348218:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 67 00000100:00100000:1.0:1789518169.351166:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518169.351298:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617029120 00000100:00100000:3.0:1789518169.351307:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617029120 00000100:00100000:2.0:1789518169.353418:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 68 00000100:00100000:2.0:1789518169.353440:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfa73850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+20:12278:x1876445617029120:12345-192.168.206.51@tcp:35:umount.0 00000100:00100000:2.0:1789518169.353676:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfa73850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+21:12278:x1876445617029120:12345-192.168.206.51@tcp:35:umount.0 Request processed in 245us (2516us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1789518169.353683:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 68 00000100:00100000:1.0:1789518169.356528:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518169.356945:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617029376 00000100:00100000:2.0:1789518169.356954:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617029376 00000100:00100000:2.0:1789518169.357007:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 69 00000100:00100000:2.0:1789518169.357017:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+21:12278:x1876445617029376:12345-192.168.206.51@tcp:35:umount.0 00000100:00100000:2.0:1789518169.357317:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+22:12278:x1876445617029376:12345-192.168.206.51@tcp:35:umount.0 Request processed in 301us (796us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1789518169.357341:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 69 00000100:00100000:0.0:1789518169.362076:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518169.362116:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518169.362150:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518169.362480:0:8784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617030144 00000100:00100000:2.0:1789518169.362489:0:8784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617030144 00000100:00100000:2.0:1789518169.362544:0:8784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:2.0:1789518169.362554:0:8784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:2341:x1876445617030144:12345-192.168.206.51@tcp:9:umount.0 00000020:00000080:2.0:1789518169.362579:0:8784:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c7811e2 00000020:00010000:2.0:1789518169.362586:0:8784:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99ffed829000: total 0 00000100:00080000:2.0:1789518169.362590:0:8784:0:(import.c:65:import_set_state_nolock()) ffff99ffed829800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789518169.362644:0:8784:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1789518169.363007:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518169.363263:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617029504 00000100:00100000:1.0:1789518169.363267:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617029504 00000100:00100000:1.0:1789518169.363293:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617029632 00000100:00100000:1.0:1789518169.363295:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617029632 00000100:00100000:1.0:1789518169.363301:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617029888 00000100:00100000:1.0:1789518169.363302:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617029888 00000100:00100000:1.0:1789518169.363313:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:1.0:1789518169.363320:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e55716f-fc49-42ce-abad-050985078c82+15:2343:x1876445617029504:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518169.363330:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518169.363347:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc28d600/0x631fd8698c780c47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc641 expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518169.363361:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518169.363381:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e55716f-fc49-42ce-abad-050985078c82+14:2343:x1876445617029504:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 61us (1314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518169.363711:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:0.0:1789518169.363717:0:5798:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e55716f-fc49-42ce-abad-050985078c82+14:2343:x1876445617029632:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518169.363723:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518169.363731:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b16200/0x631fd8698c780c0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc609 expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518169.363740:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518169.363765:0:5798:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e55716f-fc49-42ce-abad-050985078c82+13:2343:x1876445617029632:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 48us (1649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518169.363773:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:0.0:1789518169.363789:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:0.0:1789518169.363795:0:5798:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e55716f-fc49-42ce-abad-050985078c82+12:2344:x1876445617029888:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518169.363807:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518169.363816:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc2f7a00/0x631fd8698c780eb6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc70c expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518169.363824:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518169.363833:0:8784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2341:x1876445617030144:12345-192.168.206.51@tcp:9:umount.0 Request processed in 346us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518169.363851:0:5798:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e55716f-fc49-42ce-abad-050985078c82+11:2344:x1876445617029888:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 56us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518169.363858:0:8784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:0.0:1789518169.363858:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00080000:0.0:1789518169.363875:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00010000:2.0:1789518169.363910:0:5800:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99ffed829000: total 0 00010000:00010000:2.0:1789518169.363935:0:5800:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99ffed829000, canceled 0 locks, left on hash table 2. 00000100:00100000:1.0:1789518169.363956:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 16 00010000:00010000:2.0:1789518169.364104:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f6909c0/0x631fd8698c78158c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8e8 expref: 4 pid: 8784 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518169.364191:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e16297d1/0x631fd8698c781c23 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcab6 expref: 3 pid: 6649 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518169.364207:0:5800:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99ffed829000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1789518169.364218:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518169.364220:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518169.364222:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518169.367855:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518169.367941:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617030272 00000100:00100000:2.0:1789518169.367949:0:6649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617030272 00000100:00100000:2.0:1789518169.368268:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:2.0:1789518169.368277:0:6649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+5:2341:x1876445617030272:12345-192.168.206.51@tcp:9:umount.0 00000020:00000080:2.0:1789518169.368306:0:6649:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c780f81 00000100:00080000:2.0:1789518169.368315:0:6649:0:(import.c:65:import_set_state_nolock()) ffff99ffd80f8000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789518169.368366:0:6649:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1789518169.368659:0:6649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+2:2341:x1876445617030272:12345-192.168.206.51@tcp:9:umount.0 Request processed in 382us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518169.368667:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 73 00010000:00010000:3.0:1789518169.369378:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789518169.370168:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518169.373877:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518169.373972:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617031296 00000100:00100000:1.0:1789518169.373983:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617031296 00000100:00100000:1.0:1789518169.374065:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 240 00000100:00100000:1.0:1789518169.374077:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+22:2341:x1876445617031296:12345-192.168.206.51@tcp:39:umount.0 00000020:00000080:1.0:1789518169.374121:0:5812:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c780c1d 00000020:00010000:1.0:1789518169.374144:0:5812:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99fff4017000: total 0 00000100:00080000:1.0:1789518169.374150:0:5812:0:(import.c:65:import_set_state_nolock()) ffff99ffed82f800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789518169.374182:0:5812:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:2.0:1789518169.374204:0:7596:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99fff4017000: total 0 00010000:00010000:2.0:1789518169.374260:0:7596:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99fff4017000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1789518169.374315:0:7596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd2a17a00) 00010000:00010000:2.0:1789518169.374319:0:7596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789518169.374329:0:7596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c781c0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcaaf expref: 21 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518169.374352:0:7596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffc2ad3d00) 00010000:00010000:2.0:1789518169.374368:0:7596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518169.374373:0:7596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c780f03 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc721 expref: 20 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518169.374392:0:7596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:2.0:1789518169.374395:0:7596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789518169.374399:0:7596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c781577 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8e1 expref: 19 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518169.374412:0:7596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2ad3f00) 00010000:00010000:2.0:1789518169.374414:0:7596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518169.374418:0:7596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c7815e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8fd expref: 18 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518169.374444:0:7596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd2a17a00) 00010000:00010000:2.0:1789518169.374447:0:7596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518169.374451:0:7596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c781b04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfca69 expref: 17 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518169.374463:0:7596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:2.0:1789518169.374465:0:7596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518169.374469:0:7596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c78146d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc89b expref: 16 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518169.374479:0:7596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99ffc2fdc600) 00010000:00010000:2.0:1789518169.374481:0:7596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789518169.374485:0:7596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c7818db lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc9d6 expref: 15 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518169.374498:0:7596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ffd8781a00) 00010000:00010000:2.0:1789518169.374501:0:7596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789518169.374504:0:7596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c781244 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc808 expref: 14 pid: 8051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518169.374515:0:7596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99ffc2fdc100) 00010000:00010000:2.0:1789518169.374518:0:7596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518169.374521:0:7596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c780ee7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc71a expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518169.374537:0:7596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:2.0:1789518169.374540:0:7596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518169.374550:0:7596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c78154d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc8d3 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518169.374567:0:7596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ffd8781a00) 00010000:00010000:2.0:1789518169.374569:0:7596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789518169.374573:0:7596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c780f57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc736 expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518169.374587:0:7596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99ffd2a17a00) 00010000:00010000:2.0:1789518169.374590:0:7596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518169.374593:0:7596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c781be4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcaa1 expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518169.374606:0:7596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99ffc2fdc600) 00010000:00010000:2.0:1789518169.374608:0:7596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789518169.374668:0:7596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c7815fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc904 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518169.374684:0:7596:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99fff4017000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1789518169.374695:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518169.374697:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518169.374699:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518169.375415:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1c47d-1425-4fe5-be2a-28ad5152a12d+7:2341:x1876445617031296:12345-192.168.206.51@tcp:39:umount.0 Request processed in 1336us (1545us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1789518169.375426:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 240 00000100:00100000:1.0:1789518169.485332:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518169.485495:0:8051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617031424 00000100:00100000:3.0:1789518169.485508:0:8051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617031424 00000100:00100000:3.0:1789518169.485660:0:8051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 104 00000100:00100000:3.0:1789518169.485673:0:8051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e523f9d-cd98-44af-a94f-935bacbf145f+6:2342:x1876445617031424:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518169.485781:0:8051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e523f9d-cd98-44af-a94f-935bacbf145f+6:2342:x1876445617031424:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 111us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518169.485789:0:8051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 104 00010000:00010000:1.0:1789518169.525322:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518169.715183:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518169.715217:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627484800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518169.715322:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518169.715484:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627484800 00000100:00100000:1.0:1789518169.715495:0:6652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627484800 00000100:00100000:1.0:1789518169.715563:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1789518169.715569:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518169.715576:0:6652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627484800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789518169.715724:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789518169.715805:0:6652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627484800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 233us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518169.715810:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789518169.715915:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627484800:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1789518169.842871:0:11633:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789518169.842879:0:11633:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518169.843172:0:11633:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1789518169.843179:0:11633:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789518169.994144:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518169.994188:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518169.994250:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518169.994297:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617031680 00000100:00100000:2.0:1789518169.994307:0:5798:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617031680 00000100:00100000:3.0:1789518169.994364:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617031552 00000100:00100000:2.0:1789518169.994368:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617031808 00000100:00100000:3.0:1789518169.994370:0:5799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617031552 00000100:00100000:2.0:1789518169.994373:0:5798:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617031808 00000100:00100000:3.0:1789518169.994408:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:3.0:1789518169.994464:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e55716f-fc49-42ce-abad-050985078c82+12:2344:x1876445617031680:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518169.994478:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518169.994495:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc0030200/0x631fd8698c780cf6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc680 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518169.994500:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:2.0:1789518169.994516:0:5798:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e55716f-fc49-42ce-abad-050985078c82+11:2344:x1876445617031552:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518169.994517:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518169.994529:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518169.994548:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc0031a00/0x631fd8698c780cef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc656 expref: 11 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518169.994563:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518169.994568:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e55716f-fc49-42ce-abad-050985078c82+10:2344:x1876445617031680:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 104us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518169.994576:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:2.0:1789518169.994593:0:5798:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e55716f-fc49-42ce-abad-050985078c82+9:2344:x1876445617031552:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 81us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518169.994598:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:3.0:1789518169.994656:0:5799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc81d0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e55716f-fc49-42ce-abad-050985078c82+9:2344:x1876445617031808:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518169.994664:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518169.994673:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffed5bc600/0x631fd8698c780eaf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc705 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518169.994682:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518169.994702:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:3.0:1789518169.994703:0:5799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc81d0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e55716f-fc49-42ce-abad-050985078c82+8:2344:x1876445617031808:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 48us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518169.994712:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:0.0:1789518170.000008:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518170.000088:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617032064 00000100:00100000:2.0:1789518170.000098:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617032064 00000100:00100000:1.0:1789518170.000188:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 241 00000100:00100000:1.0:1789518170.000199:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e523f9d-cd98-44af-a94f-935bacbf145f+6:2341:x1876445617032064:12345-192.168.206.51@tcp:39:umount.0 00000020:00000080:1.0:1789518170.000233:0:5812:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c780d04 00000020:00010000:1.0:1789518170.000239:0:5812:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99ffc4f47800: total 0 00000100:00080000:1.0:1789518170.000249:0:5812:0:(import.c:65:import_set_state_nolock()) ffff99ffc4f43800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789518170.000282:0:5812:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:1.0:1789518170.000472:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e523f9d-cd98-44af-a94f-935bacbf145f+5:2341:x1876445617032064:12345-192.168.206.51@tcp:39:umount.0 Request processed in 275us (472us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1789518170.000477:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 241 00000020:00010000:2.0:1789518170.000540:0:5800:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99ffc4f47800: total 0 00010000:00010000:2.0:1789518170.000570:0:5800:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99ffc4f47800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789518170.000602:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2ad3f00) 00010000:00010000:2.0:1789518170.000606:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518170.000634:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c781c31 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcabd expref: 4 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518170.000656:0:5800:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99ffc4f47800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1789518170.000669:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518170.000671:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518170.000674:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518170.014208:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518170.014303:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617032320 00000100:00100000:1.0:1789518170.014315:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617032320 00000100:00100000:1.0:1789518170.014375:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 274 00000100:00100000:1.0:1789518170.014386:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd801e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+7:2341:x1876445617032320:12345-192.168.206.51@tcp:251:umount.0 00000020:00000080:1.0:1789518170.014430:0:5807:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c780bfa 00000020:00010000:1.0:1789518170.014438:0:5807:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99ffec075800: total 0 00000100:00080000:1.0:1789518170.014442:0:5807:0:(import.c:65:import_set_state_nolock()) ffff99fff415e800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789518170.014521:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd801e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e55716f-fc49-42ce-abad-050985078c82+3:2341:x1876445617032320:12345-192.168.206.51@tcp:251:umount.0 Request processed in 137us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518170.014527:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 274 00000020:00010000:3.0:1789518170.014601:0:5801:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99ffec075800: total 0 00010000:00010000:3.0:1789518170.014642:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518170.014704:0:5801:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99ffec075800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789518170.014824:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc28ca00/0x631fd8698c780c4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfc648 expref: 2 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.014877:0:5801:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99ffec075800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1789518170.014894:0:5801:0:(genops.c:885:class_export_put()) final put ffff99ffec075800/2e55716f-fc49-42ce-abad-050985078c82 00010000:00010000:3.0:1789518170.014912:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518170.014914:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518170.014916:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789518170.014947:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffec075800/2e55716f-fc49-42ce-abad-050985078c82 for MGS 00000020:00000080:2.0:1789518170.015069:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99fff415e800 for MGS 00010000:00010000:3.0:1789518170.547706:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789518170.989439:0:13012:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789518170.995819:0:13012:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1789518170.995882:0:13012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16a00/0x631fd8698c780cb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780cbe expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518170.995896:0:13012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16a00/0x631fd8698c780cb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780cbe expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518170.995917:0:13012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16a00/0x631fd8698c780cb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c780cbe expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518170.995924:0:13012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16a00/0x631fd8698c780cb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c780cbe expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518170.995988:0:13012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789518170.995995:0:13012:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1789518170.996032:0:7595:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518170.996039:0:7595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16a00/0x631fd8698c780cb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c780cbe expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.996047:0:7595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16a00 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:0.0:1789518170.996050:0:7595:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16a00/0x631fd8698c780cb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c780cbe expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789518170.996057:0:13012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:0.0:1789518170.996058:0:7595:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16a00/0x631fd8698c780cb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c780cbe expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518170.996061:0:13012:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 10000000:00010000:0.0:1789518170.996065:0:7595:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16a00/0x631fd8698c780cb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c780cbe expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789518170.996066:0:13012:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 10000000:01000000:0.0:1789518170.996070:0:7595:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789518170.996073:0:7595:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789518170.996075:0:7595:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00080000:2.0:1789518170.996087:0:13012:0:(import.c:65:import_set_state_nolock()) ffff99ffec071800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1789518170.996097:0:7595:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16a00/0x631fd8698c780cb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c780cbe expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.996103:0:7595:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518170.996119:0:7595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16a00/0x631fd8698c780cb7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c780cbe expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.996126:0:7595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16a00/0x631fd8698c780cb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c780cbe expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518170.996129:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1789518170.996136:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518170.996138:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518170.996144:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffedb2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:824c8f07-28fa-48fd-81af-173b194570e6:3283:1876445627485056:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789518170.996146:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518170.996208:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876445627484928:0@lo:39:umount.0 00000100:00100000:2.0:1789518170.996208:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518170.996261:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518170.996291:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627484928 00000100:00100000:1.0:1789518170.996300:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627484928 00000100:00100000:0.0:1789518170.996315:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627485056 00000100:00100000:0.0:1789518170.996322:0:5798:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627485056 00000100:00100000:1.0:1789518170.996349:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789518170.996361:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876445627484928:12345-0@lo:39:umount.0 00000100:00100000:0.0:1789518170.996368:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789518170.996378:0:5798:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:824c8f07-28fa-48fd-81af-173b194570e6+19:3283:x1876445627485056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789518170.996389:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:1.0:1789518170.996401:0:5813:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c780a09 00010000:00010000:0.0:1789518170.996403:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc29e0600/0x631fd8698c780cbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c780cb7 expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789518170.996411:0:5813:0:(import.c:65:import_set_state_nolock()) ffff99ffd925f000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789518170.996416:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518170.996459:0:5798:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:824c8f07-28fa-48fd-81af-173b194570e6+18:3283:x1876445627485056:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518170.996467:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789518170.996486:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3279:x1876445627484928:12345-0@lo:39:umount.0 Request processed in 126us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518170.996504:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789518170.996509:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffedb2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:824c8f07-28fa-48fd-81af-173b194570e6:3283:1876445627485056:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1789518170.996513:0:5813:0:(genops.c:885:class_export_put()) final put ffff99ffec070800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1789518170.996528:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789518170.996543:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffec070800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:0.0:1789518170.996548:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffec071800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789518170.996562:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876445627484928:0@lo:39:umount.0 00000100:00080000:0.0:1789518170.996579:0:13012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789518170.996582:0:13012:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789518170.996585:0:13012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789518170.996599:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffd925f000 for lustre-MDT0000 00010000:00010000:0.0:1789518170.997526:0:13012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1e00/0x631fd8698c780cc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780ccc expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.997537:0:13012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1e00/0x631fd8698c780cc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780ccc expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.997544:0:13012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1e00/0x631fd8698c780cc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c780ccc expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.997565:0:13012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1e00/0x631fd8698c780cc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c780ccc expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.997595:0:13012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518170.997601:0:13012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc0030800/0x631fd8698c780bb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780bbb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.997607:0:13012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc0030800/0x631fd8698c780bb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780bbb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.997631:0:13012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc0030800/0x631fd8698c780bb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c780bbb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.997638:0:13012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99ffc0030800/0x631fd8698c780bb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c780bbb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.997656:0:13012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789518170.997662:0:13012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9800/0x631fd8698c780ea1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780ea8 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.997668:0:13012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9800/0x631fd8698c780ea1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780ea8 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.997674:0:13012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9800/0x631fd8698c780ea1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c780ea8 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.997680:0:13012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9800/0x631fd8698c780ea1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c780ea8 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.997704:0:13012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1789518170.997715:0:7595:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789518170.997720:0:7595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1e00/0x631fd8698c780cc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c780ccc expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.997726:0:7595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1e00 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:0.0:1789518170.997730:0:7595:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1e00/0x631fd8698c780cc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c780ccc expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.997737:0:7595:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1e00/0x631fd8698c780cc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c780ccc expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518170.997744:0:7595:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1e00/0x631fd8698c780cc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c780ccc expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518170.997749:0:7595:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789518170.997751:0:7595:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1789518170.997770:0:7595:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1e00/0x631fd8698c780cc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c780ccc expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.997777:0:7595:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518170.997794:0:7595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1e00/0x631fd8698c780cc5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c780ccc expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.997801:0:7595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1e00/0x631fd8698c780cc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c780ccc expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.997806:0:7596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789518170.997811:0:7595:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518170.997812:0:7596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc0030800/0x631fd8698c780bb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c780bbb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.997814:0:7595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9800/0x631fd8698c780ea1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c780ea8 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.997818:0:7596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc0030800 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:3.0:1789518170.997821:0:7596:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc0030800/0x631fd8698c780bb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c780bbb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.997825:0:7595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29c9800 already unused, calling callback (ffffffffc1b17c20) 00010000:00010000:3.0:1789518170.997839:0:7596:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc0030800/0x631fd8698c780bb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c780bbb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518170.997840:0:7595:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9800/0x631fd8698c780ea1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c780ea8 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518170.997846:0:7596:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc0030800/0x631fd8698c780bb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c780bbb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.997848:0:7595:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9800/0x631fd8698c780ea1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c780ea8 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518170.997852:0:7596:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:00010000:0.0:1789518170.997854:0:7595:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9800/0x631fd8698c780ea1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c780ea8 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518170.997855:0:7596:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1789518170.997857:0:7596:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 10000000:01000000:0.0:1789518170.997859:0:7595:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789518170.997860:0:7595:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789518170.997862:0:7595:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789518170.997872:0:7596:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffc0030800/0x631fd8698c780bb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c780bbb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.997872:0:7595:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9800/0x631fd8698c780ea1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c780ea8 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.997878:0:7595:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518170.997887:0:7596:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518170.997891:0:7595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9800/0x631fd8698c780ea1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c780ea8 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.997893:0:7596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc0030800/0x631fd8698c780bb4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c780bbb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.997898:0:7595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9800/0x631fd8698c780ea1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c780ea8 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.997900:0:7596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc0030800/0x631fd8698c780bb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c780bbb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.997911:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518170.997913:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518170.997913:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518170.997914:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518170.997915:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518170.997915:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518170.997927:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffedb28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:824c8f07-28fa-48fd-81af-173b194570e6:3280:1876445627485440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518170.997927:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffedb2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:824c8f07-28fa-48fd-81af-173b194570e6:3283:1876445627485184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518170.997976:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518170.997997:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518170.998011:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518170.998017:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:824c8f07-28fa-48fd-81af-173b194570e6:3280:1876445627485312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518170.998020:0:7597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627485184 00000100:00100000:0.0:1789518170.998030:0:7597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627485184 00000100:00100000:3.0:1789518170.998037:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518170.998055:0:7597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627485440 00000100:00100000:3.0:1789518170.998057:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627485312 00000100:00100000:0.0:1789518170.998058:0:7597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627485440 00000100:00100000:3.0:1789518170.998060:0:5798:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627485312 00000100:00100000:0.0:1789518170.998073:0:7597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789518170.998079:0:7597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:824c8f07-28fa-48fd-81af-173b194570e6+20:3283:x1876445627485184:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518170.998086:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789518170.998092:0:5798:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:824c8f07-28fa-48fd-81af-173b194570e6+20:3280:x1876445627485440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789518170.998102:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518170.998112:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffed5bd400/0x631fd8698c780ea8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c780ea1 expref: 20 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.998122:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518170.998131:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518170.998150:0:5798:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:824c8f07-28fa-48fd-81af-173b194570e6+19:3280:x1876445627485440:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518170.998156:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1789518170.998157:0:13012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc0031c00/0x631fd8698c780968 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78096f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518170.998165:0:13012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc0031c00/0x631fd8698c780968 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c78096f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518170.998171:0:13012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc0031c00/0x631fd8698c780968 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c78096f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518170.998176:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1789518170.998178:0:13012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99ffc0031c00/0x631fd8698c780968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c78096f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518170.998181:0:5798:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:824c8f07-28fa-48fd-81af-173b194570e6+18:3280:x1876445627485312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789518170.998188:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518170.998189:0:13012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789518170.998192:0:13012:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1789518170.998195:0:13012:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1789518170.998196:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc28dc00/0x631fd8698c780bbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c780bb4 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.998205:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:01000004:1.0:1789518170.998217:0:13012:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1789518170.998220:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1789518170.998224:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000100:00100000:3.0:1789518170.998225:0:5798:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:824c8f07-28fa-48fd-81af-173b194570e6+17:3280:x1876445627485312:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (188us total) trans 0 rc 0/0 00000020:00000080:1.0:1789518170.998229:0:13012:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000100:00100000:3.0:1789518170.998230:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000020:00080000:1.0:1789518170.998233:0:13012:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff99fffdc8d800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789518170.998238:0:13012:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff99ffffa5b000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1789518170.998245:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:00080000:1.0:1789518170.998245:0:13012:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff99ffc4f47800 0e523f9d-cd98-44af-a94f-935bacbf145f 192.168.206.51@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1789518170.998249:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc0031c00/0x631fd8698c780968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c78096f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789518170.998250:0:13012:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff99fff4017000 cfa1c47d-1425-4fe5-be2a-28ad5152a12d 192.168.206.51@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00010000:00010000:3.0:1789518170.998256:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc0031c00 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:3.0:1789518170.998258:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc0031c00/0x631fd8698c780968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c78096f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789518170.998260:0:13012:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff99ffc6510000) has exports, disconnecting them 00000020:00080000:1.0:1789518170.998264:0:13012:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99fffdc8d800), last request at 1789518167 00010000:00010000:3.0:1789518170.998265:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc0031c00/0x631fd8698c780968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c78096f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789518170.998269:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c780b7c 10000000:00010000:3.0:1789518170.998271:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc0031c00/0x631fd8698c780968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c78096f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518170.998276:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789518170.998278:0:5800:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1789518170.998279:0:5800:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00080000:1.0:1789518170.998280:0:13012:0:(import.c:65:import_set_state_nolock()) ffff99fffdc8a000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789518170.998291:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffc0031c00/0x631fd8698c780968 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c78096f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518170.998305:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:1.0:1789518170.998311:0:13012:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99fffdc8d800): rc 0 00000020:00000080:1.0:1789518170.998313:0:13012:0:(genops.c:885:class_export_put()) final put ffff99fffdc8d800/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:3.0:1789518170.998316:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc0031c00/0x631fd8698c780968 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c78096f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789518170.998321:0:13012:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99ffffa5b000), last request at 1789518167 00010000:00010000:3.0:1789518170.998322:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc0031c00/0x631fd8698c780968 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c78096f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789518170.998324:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c780ab1 00000100:00080000:1.0:1789518170.998328:0:13012:0:(import.c:65:import_set_state_nolock()) ffff99ffffa58000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789518170.998334:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518170.998336:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518170.998337:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789518170.998339:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99fffdc8d800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:3.0:1789518170.998341:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518170.998357:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:824c8f07-28fa-48fd-81af-173b194570e6:3280:1876445627485312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518170.998364:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffedb28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:824c8f07-28fa-48fd-81af-173b194570e6:3280:1876445627485440:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1789518170.998370:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99fffdc8a000 for lustre-MDT0000 00000020:00080000:1.0:1789518170.998383:0:13012:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ffffa5b000): rc 0 00000020:00000080:1.0:1789518170.998385:0:13012:0:(genops.c:885:class_export_put()) final put ffff99ffffa5b000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1789518170.998393:0:13012:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa50843aa7ae0 00000020:00000080:1.0:1789518170.998402:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffffa5b000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1789518170.998421:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffffa58000 for lustre-MDT0000 00000100:00080000:1.0:1789518170.998439:0:13012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789518170.998442:0:13012:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1789518170.998453:0:13012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789518170.998516:0:13012:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1789518170.998528:0:13012:0:(import.c:65:import_set_state_nolock()) ffff99ffffbf7800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1789518170.998539:0:13012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789518170.998542:0:13012:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1789518170.998548:0:13012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789518170.998628:0:13012:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1789518170.998636:0:13012:0:(import.c:65:import_set_state_nolock()) ffff99ffdf98e800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1789518170.998661:0:13012:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff99ffc6510000) has no exports 00010000:00010000:1.0:1789518170.998687:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518170.998702:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:824c8f07-28fa-48fd-81af-173b194570e6:3282:1876445627485568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789518170.998729:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518170.998749:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627485696:0@lo:9:umount.0 00000100:00100000:1.0:1789518170.998752:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627485568 00000100:00100000:1.0:1789518170.998755:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627485568 00000100:00100000:1.0:1789518170.998779:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789518170.998786:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2975880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:824c8f07-28fa-48fd-81af-173b194570e6+17:3282:x1876445627485568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789518170.998793:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518170.998802:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc29c9000/0x631fd8698c78096f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c780968 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518170.998816:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518170.998847:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518170.998855:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2975880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:824c8f07-28fa-48fd-81af-173b194570e6+16:3282:x1876445627485568:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518170.998861:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789518170.998864:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627485824:0@lo:9:umount.0 00000100:00100000:3.0:1789518170.998885:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518170.998885:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:824c8f07-28fa-48fd-81af-173b194570e6:3282:1876445627485568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518170.998910:0:6648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627485824 00000100:00100000:1.0:1789518170.998910:0:8784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627485696 00000100:00100000:3.0:1789518170.998913:0:6648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627485824 00000100:00100000:1.0:1789518170.998913:0:8784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627485696 00000100:00100000:1.0:1789518170.998937:0:8784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789518170.998941:0:6648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789518170.998943:0:8784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1876445627485696:12345-0@lo:9:umount.0 00000100:00100000:3.0:1789518170.998946:0:6648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1876445627485824:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789518170.998958:0:6648:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c780be5 00000020:00000080:1.0:1789518170.998958:0:8784:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c780afe 00000100:00080000:3.0:1789518170.998963:0:6648:0:(import.c:65:import_set_state_nolock()) ffff99fff4016000 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1789518170.998963:0:8784:0:(import.c:65:import_set_state_nolock()) ffff99ffff796800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789518170.998998:0:6648:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00010000:00010000:2.0:1789518170.999047:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518170.999058:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1789518170.999105:0:8784:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:0.0:1789518170.999294:0:7597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789518170.999314:0:6648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3279:x1876445627485824:12345-0@lo:9:umount.0 Request processed in 367us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518170.999314:0:8784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3279:x1876445627485696:12345-0@lo:9:umount.0 Request processed in 370us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518170.999321:0:8784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789518170.999328:0:6648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1789518170.999344:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789518170.999397:0:7597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc28d800/0x631fd8698c780ccc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c780cc5 expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518170.999406:0:7597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518170.999445:0:7597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:824c8f07-28fa-48fd-81af-173b194570e6+14:3283:x1876445627485184:12345-0@lo:103:ldlm_bl.0 Request processed in 1366us (1469us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518170.999451:0:7597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789518170.999511:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffedb2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:824c8f07-28fa-48fd-81af-173b194570e6:3283:1876445627485184:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1789518170.999561:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffffbf7800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789518170.999604:0:3279:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789518171.000068:0:3279:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789518171.000073:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627485696:0@lo:9:umount.0 00000100:00080000:2.0:1789518171.000087:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffdf98e800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789518171.000103:0:3279:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789518171.000105:0:3279:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789518171.000108:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627485824:0@lo:9:umount.0 00010000:00010000:3.0:1789518171.570853:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789518171.793866:0:7607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cfa1c47d-1425-4fe5-be2a-28ad5152a12d 00000020:00000080:3.0:1789518171.793873:0:7607:0:(genops.c:885:class_export_put()) final put ffff99ffed829000/cfa1c47d-1425-4fe5-be2a-28ad5152a12d 00000001:00100000:3.0:1789518171.793894:0:7607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789518171.793897:0:7607:0:(genops.c:885:class_export_put()) final put ffff99ffc76f2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789518171.794993:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffed829000/cfa1c47d-1425-4fe5-be2a-28ad5152a12d for lustre-OST0001 00000020:00000080:1.0:1789518171.795041:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc76f2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789518171.795060:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffed829800 for lustre-OST0001 00000020:00000080:1.0:1789518171.795064:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99fff4016000 for lustre-OST0001 00000001:00100000:1.0:1789518171.797869:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0e523f9d-cd98-44af-a94f-935bacbf145f 00000001:00080000:1.0:1789518171.797881:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1789518171.797886:0:5833:0:(genops.c:885:class_export_put()) final put ffff99ffc4f47800/0e523f9d-cd98-44af-a94f-935bacbf145f 00000001:00100000:1.0:1789518171.797907:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cfa1c47d-1425-4fe5-be2a-28ad5152a12d 00000001:00080000:1.0:1789518171.797912:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1789518171.797922:0:5833:0:(genops.c:885:class_export_put()) final put ffff99fff4017000/cfa1c47d-1425-4fe5-be2a-28ad5152a12d 00000020:00080000:1.0:1789518171.797929:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1789518171.797981:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99ffc2af10c0 refcount 1 committed 1 result 0 batchid 8 00000020:00080000:3.0:1789518171.797986:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff420bf00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99ffc2af1900 00000020:00080000:3.0:1789518171.797989:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff420bb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99ffff547c00 00000020:00000080:2.0:1789518171.798081:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc4f47800/0e523f9d-cd98-44af-a94f-935bacbf145f for lustre-MDT0000 00000020:00000080:2.0:1789518171.798886:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99fff4017000/cfa1c47d-1425-4fe5-be2a-28ad5152a12d for lustre-MDT0000 00000020:00000080:2.0:1789518171.801889:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffc4f43800 for lustre-MDT0000 00000020:00000080:2.0:1789518171.801903:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffed82f800 for lustre-MDT0000 00000020:00080000:1.0:1789518171.808177:0:13012:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff99ffc6510000) has no exports 00000020:00000080:1.0:1789518171.848169:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c7809c3 00000020:00000080:1.0:1789518171.848182:0:13012:0:(genops.c:885:class_export_put()) final put ffff99ffedb7e800/lustre-QMT0000_UUID 00000020:01000000:1.0:1789518171.848234:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1789518171.848307:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789518171.848318:0:13012:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789518171.848322:0:13012:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff99ffd10f8000) has no exports 00000020:00000080:0.0:1789518171.849551:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c7809bc 00000020:00000080:0.0:1789518171.849558:0:13012:0:(genops.c:885:class_export_put()) final put ffff99ffee443800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789518171.851801:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffedb7e800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1789518171.851820:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffee443800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789518171.852187:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789518171.852204:0:13012:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789518171.852209:0:13012:0:(genops.c:885:class_export_put()) final put ffff99ffee441000/lustre-QMT0000_UUID 00000020:00000080:2.0:1789518171.852212:0:13012:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffee441000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1789518171.852216:0:13012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1789518171.852354:0:13012:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99ffd8114ba0 - data ffff99fff7e51510/ffff99fff7adc000 00000020:01000000:2.0:1789518171.852485:0:13012:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99ffdfd52f60 - data ffff9a0000b781b0/ffff99ffc64cec00 00000001:00000004:3.0:1789518171.864783:0:13012:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:0.0:1789518171.911070:0:13012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789518171.911078:0:13012:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1789518171.911100:0:13012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789518171.911103:0:13012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789518171.911436:0:7463:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789518171.911441:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:2.0:1789518171.911450:0:7463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1789518171.912427:0:13012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789518171.912431:0:13012:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:1.0:1789518171.912448:0:13012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789518171.912450:0:13012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789518171.912725:0:8167:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789518171.912728:0:8167:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1789518171.912735:0:8167:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1789518171.966031:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c78098b 00000020:00000080:0.0:1789518171.966043:0:13012:0:(genops.c:885:class_export_put()) final put ffff99ffedb70800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789518171.966247:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffedb70800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789518171.966900:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c7809a0 00000020:00000080:0.0:1789518171.966907:0:13012:0:(genops.c:885:class_export_put()) final put ffff99ffedb7d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789518171.966956:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1789518171.966962:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789518171.966976:0:13012:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789518171.966980:0:13012:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff99ffc65119c0) has no exports 00000004:01000000:0.0:1789518171.967153:0:13012:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1789518171.967160:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c780bde 00000020:00000080:0.0:1789518171.967163:0:13012:0:(genops.c:885:class_export_put()) final put ffff99ffec072000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789518171.968582:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffedb7d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1789518171.968837:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffec072000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789518171.968867:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789518171.968981:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789518171.968991:0:13012:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789518171.968995:0:13012:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff99ffc64a0000) has no exports 00000020:00000080:1.0:1789518171.969003:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c780bd7 00000020:00000080:1.0:1789518171.969009:0:13012:0:(genops.c:885:class_export_put()) final put ffff99ffdf989800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1789518171.969426:0:13012:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789518171.969430:0:13012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789518171.969434:0:13012:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1789518171.969440:0:13012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789518171.969447:0:13012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789518171.969490:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffdf989800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789518171.969580:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789518171.969587:0:13012:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789518171.969592:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c780af7 00000020:00000080:1.0:1789518171.969596:0:13012:0:(genops.c:885:class_export_put()) final put ffff99ffc8077000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789518171.969695:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffdf98e800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789518171.969701:0:36:0:(genops.c:885:class_export_put()) final put ffff99ffc8074000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789518171.969703:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc8074000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1789518171.969758:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789518171.970078:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789518171.970083:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789518171.970088:0:13012:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789518171.970090:0:13012:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff99ffc64a19c0) has no exports 00000020:00000080:1.0:1789518171.970094:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c780af0 00000020:00000080:1.0:1789518171.970098:0:13012:0:(genops.c:885:class_export_put()) final put ffff99ffffbf6000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789518171.970115:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc8077000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:1.0:1789518171.970543:0:13012:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789518171.970546:0:13012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789518171.970549:0:13012:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1789518171.970556:0:13012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789518171.970558:0:13012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789518171.970578:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffffbf6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789518171.970681:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789518171.970686:0:13012:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789518171.970709:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789518171.970711:0:13012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789518171.970714:0:13012:0:(genops.c:885:class_export_put()) final put ffff99ffedb77800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789518171.970716:0:13012:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffedb77800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1789518171.970723:0:13012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789518171.970891:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c7809a7 00000020:00000080:1.0:1789518171.970897:0:13012:0:(genops.c:885:class_export_put()) final put ffff99ffedb7a000/lustre-MDD0000_UUID 00000020:00000080:2.0:1789518171.971462:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffffbf7800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1789518171.971470:0:36:0:(genops.c:885:class_export_put()) final put ffff99ffffbf0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789518171.971472:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffffbf0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1789518171.971486:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789518171.971642:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1789518171.971647:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789518171.971653:0:13012:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789518171.971656:0:13012:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff99ffc6514d40) has no exports 00000020:00000080:1.0:1789518171.971677:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789518171.971681:0:13012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1789518171.971685:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c7809ae 00000020:00000080:1.0:1789518171.971688:0:13012:0:(genops.c:885:class_export_put()) final put ffff99ffedb7c800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789518171.971771:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffedb7a000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1789518171.971776:0:36:0:(genops.c:885:class_export_put()) final put ffff99ffedb71800/lustre-MDD0000_UUID 00000020:00000080:2.0:1789518171.971778:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffedb71800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1789518171.971782:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:1.0:1789518171.972084:0:13012:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ffc84db000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1789518171.972089:0:13012:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffc84db000 3 00000020:01000004:1.0:1789518171.972092:0:13012:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99ffc84db000 from lustre-MDT0000 00000020:00000080:1.0:1789518171.972108:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789518171.972113:0:13012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1789518171.972115:0:13012:0:(genops.c:885:class_export_put()) final put ffff99ffedb75800/lustre-MDT0000_UUID 00000020:00000080:1.0:1789518171.972117:0:13012:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffedb75800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1789518171.972124:0:13012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1789518171.972151:0:13012:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1789518171.972154:0:13012:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1789518171.972156:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1789518171.972159:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789518171.972161:0:13012:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789518171.972167:0:13012:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff99ffd1030000 824c8f07-28fa-48fd-81af-173b194570e6 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789518171.972171:0:13012:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff99ffd10f99c0) has exports, disconnecting them 00000020:00080000:1.0:1789518171.972175:0:13012:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff99ffd1030000), last request at 1789518039 00000020:00000080:1.0:1789518171.972188:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c78094c 00000020:00010000:1.0:1789518171.972192:0:13012:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99ffd1030000: total 1 00000100:00080000:1.0:1789518171.972195:0:13012:0:(import.c:65:import_set_state_nolock()) ffff99ffd1032800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789518171.972244:0:13012:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ffd1030000): rc 0 00000020:00080000:1.0:1789518171.972247:0:13012:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff99ffd10f99c0) has no exports 00000100:00100000:1.0:1789518171.972298:0:5805:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff99ffc6ad3000:5805] 0 exiting: rc = 1 00000100:00100000:1.0:1789518171.972369:0:5807:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff99ffc81ffe00:5807] 2 exiting: rc = 0 00000100:00100000:1.0:1789518171.972407:0:5806:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff99ffc81ff400:5806] 1 exiting: rc = 0 00000100:00100000:1.0:1789518171.972453:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972461:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972467:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972473:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972479:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972485:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972491:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972496:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972512:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972521:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972527:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972532:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972536:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972542:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972548:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972553:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972558:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972564:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972569:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972574:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972580:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972585:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972590:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972595:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972600:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972605:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972609:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972630:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972636:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972642:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972646:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972652:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972657:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972662:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972667:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972672:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972677:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972682:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972687:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972692:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972696:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972701:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972707:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972720:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972725:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972730:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972735:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972740:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972745:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972751:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972756:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972760:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972765:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972771:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972776:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972781:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972786:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972791:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972795:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972800:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972804:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972809:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972813:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518171.972818:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:0.0:1789518171.973164:0:7595:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99ffd1030000: total 1 00010000:00010000:0.0:1789518171.973194:0:7595:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99ffd1030000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1789518171.973219:0:7595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc29c8800/0x631fd8698c780e8c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c780e85 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518171.973235:0:7595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c780e9a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c780e93 expref: 8 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518171.973254:0:7595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b17600/0x631fd8698c780c6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c780c63 expref: 7 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518171.973266:0:7595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc28c000/0x631fd8698c780ce8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c780ce1 expref: 6 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789518171.973276:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffedb7c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1789518171.973277:0:7595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc28c400/0x631fd8698c780c78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c780c71 expref: 5 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518171.973292:0:7595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc29e0e00/0x631fd8698c780c94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c780c8d expref: 4 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518171.973303:0:7595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc29c9e00/0x631fd8698c780a64 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c780a5d expref: 3 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518171.973319:0:7595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc28c800/0x631fd8698c780ca2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c780c9b expref: 2 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518171.973343:0:7595:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99ffd1030000, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1789518171.973355:0:7595:0:(genops.c:885:class_export_put()) final put ffff99ffd1030000/824c8f07-28fa-48fd-81af-173b194570e6 00010000:00010000:0.0:1789518171.973370:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518171.973372:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518171.973374:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789518171.973389:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffd1030000/824c8f07-28fa-48fd-81af-173b194570e6 for MGS 00000020:00000080:2.0:1789518171.973429:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffd1032800 for MGS 20000000:01000000:1.0:1789518171.973493:0:13012:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789518171.973497:0:13012:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1789518171.974345:0:13012:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99ffed4d3180 - data ffff99ffd97621b0/ffff99fff7a55000 00000020:01000000:1.0:1789518171.974552:0:13012:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99ffc67ef840 - data ffff9a0000b76870/ffff99ffd84a7400 00000020:00000080:2.0:1789518171.975318:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c780930 00000020:00000080:2.0:1789518171.975325:0:13012:0:(genops.c:885:class_export_put()) final put ffff99ffc84dd000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1789518171.975338:0:13012:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ffc84db000 from MGS, refs=2 00000020:01000004:2.0:1789518171.975341:0:13012:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffc84db000 2 00000020:01000004:2.0:1789518171.975344:0:13012:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99ffc84db000 from MGS 00000020:00000080:2.0:1789518171.975363:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789518171.975369:0:13012:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1789518171.975372:0:13012:0:(genops.c:885:class_export_put()) final put ffff99ffc84d8800/MGS 00000020:00000080:2.0:1789518171.975376:0:13012:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc84d8800/MGS for MGS 00000020:01000000:2.0:1789518171.975382:0:13012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:0.0:1789518171.975382:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc84dd000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1789518171.975426:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1789518171.975430:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789518171.975435:0:13012:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789518171.975441:0:13012:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff99fff415f800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789518171.975446:0:13012:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff99fff4200000) has exports, disconnecting them 00000020:00080000:2.0:1789518171.975450:0:13012:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff99fff415f800), last request at 1789518039 00000020:00000080:2.0:1789518171.975454:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c7809fb 00000020:00080000:2.0:1789518171.975464:0:13012:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99fff415f800): rc 0 00000020:00000080:2.0:1789518171.975468:0:13012:0:(genops.c:885:class_export_put()) final put ffff99fff415f800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789518171.975500:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99fff415f800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789518171.978660:0:13012:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789518171.978667:0:13012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789518171.978671:0:13012:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789518171.978676:0:13012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789518171.978722:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffec071800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789518171.978842:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789518171.978849:0:13012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1789518171.978853:0:13012:0:(genops.c:885:class_export_put()) final put ffff99ffec073800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789518171.978857:0:13012:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffec073800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1789518171.978862:0:13012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789518171.978908:0:13012:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffc84db000 1 00000020:00000080:0.0:1789518171.978913:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c780922 00000020:00000080:0.0:1789518171.978917:0:13012:0:(genops.c:885:class_export_put()) final put ffff99ffc84d8000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789518171.978931:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789518171.978935:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789518171.978938:0:13012:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789518171.978942:0:13012:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff99ffd10fb380) has no exports 00000020:00000080:1.0:1789518171.979244:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc84d8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789518171.997080:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789518171.997093:0:13012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1789518171.997099:0:13012:0:(genops.c:885:class_export_put()) final put ffff99ffc84df800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789518171.997103:0:13012:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc84df800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789518171.997111:0:13012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1789518171.997310:0:13012:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99ffc84d9000 00000020:01000000:0.0:1789518171.997335:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1789518171.997339:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789518171.997344:0:13012:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789518171.997348:0:13012:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff99ffc6513380) has no exports 00000100:00100000:1.0:1789518171.997526:0:5811:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff99ffc652a600:5811] 0 exiting: rc = 1 00000100:00100000:1.0:1789518171.997674:0:5812:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff99ffc6537600:5812] 1 exiting: rc = 0 00000100:00100000:1.0:1789518171.997744:0:5813:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff99ffc652b600:5813] 2 exiting: rc = 0 00000100:00100000:3.0:1789518171.997795:0:8051:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff99ffc6aac200:8051] 3 exiting: rc = 0 00000100:00100000:0.0:1789518171.998002:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998013:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998025:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998031:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998036:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998041:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998046:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998057:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998067:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998071:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998078:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998087:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998090:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998093:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998105:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998110:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998115:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998123:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998131:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998141:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998149:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998157:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998166:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998175:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998184:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998192:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998199:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998208:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998217:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998227:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998246:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998254:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998263:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998272:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998284:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998295:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998305:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998316:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998326:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998337:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998347:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998355:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998363:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998374:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998383:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998391:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998400:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998410:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998421:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998432:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998456:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998467:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998639:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998647:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998654:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998661:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998669:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998675:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998680:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998686:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998743:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998751:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998759:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518171.998767:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.006607:0:5815:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff99ffc6536600:5815] 1 exiting: rc = 0 00000100:00100000:2.0:1789518172.006701:0:5814:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff99ffc6536c00:5814] 0 exiting: rc = 1 00000100:00100000:0.0:1789518172.006897:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.006918:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.006923:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.006928:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.006934:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.006940:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.006945:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.006950:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.006955:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.006959:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.006964:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.006969:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.006975:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.006979:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.006983:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.006988:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.006993:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.006997:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007001:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007005:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007010:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007014:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007018:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007023:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007028:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007032:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007038:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007042:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007046:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007052:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007057:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007062:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007067:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007071:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007076:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007081:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007093:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007098:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007103:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007107:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007111:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007116:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007121:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007125:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007130:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007134:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007139:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007143:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007148:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007153:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007157:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007161:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007166:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007171:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007175:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007180:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007185:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007190:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007196:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007201:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007206:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007210:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007215:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.007220:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008004:0:12017:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff99ffdb10ec00:12017] 2 exiting: rc = 0 00000100:00100000:2.0:1789518172.008071:0:5816:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff99ffc6537800:5816] 0 exiting: rc = 1 00000100:00100000:1.0:1789518172.008296:0:5817:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff99ffc6536800:5817] 1 exiting: rc = 0 00000100:00100000:3.0:1789518172.008364:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008379:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008390:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008402:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008409:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008427:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008439:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008451:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008461:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008472:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008538:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008551:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008563:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008575:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008587:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008598:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008647:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008677:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008688:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008700:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008712:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008724:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008735:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008744:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008755:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008766:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008777:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008788:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008797:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008835:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008844:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008852:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008859:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008865:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008872:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008880:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008889:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008898:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008908:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008914:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008921:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008943:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008950:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008956:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008962:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008967:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008973:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008979:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008984:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008989:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.008994:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.009006:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.009011:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.009029:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.009036:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.009042:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.009047:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.009054:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.009059:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.009065:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.009071:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.009076:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.009081:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.009094:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.015881:0:5819:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff99ffd802c400:5819] 1 exiting: rc = 0 00000100:00100000:0.0:1789518172.015881:0:5818:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff99ffc6536a00:5818] 0 exiting: rc = 1 00000100:00100000:3.0:1789518172.015980:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.015987:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.015993:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016000:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016005:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016010:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016016:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016021:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016025:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016031:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016035:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016040:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016044:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016048:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016053:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016057:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016062:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016066:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016071:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016075:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016080:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016085:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016096:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016100:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016105:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016109:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016114:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016119:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016124:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016128:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016133:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016137:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016141:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016146:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016150:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016155:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016160:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016164:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016169:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016174:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016180:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016184:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016189:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016194:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016198:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016203:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016208:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016213:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016217:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016221:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016226:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016231:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016236:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016241:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016246:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016252:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016257:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016268:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016273:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016278:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016284:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016289:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016294:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.016298:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518172.016672:0:5821:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff99ffc64c5200:5821] 1 exiting: rc = 0 00000100:00100000:3.0:1789518172.016674:0:5820:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff99ffc64c4800:5820] 0 exiting: rc = 1 00000100:00100000:3.0:1789518172.017381:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017387:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017391:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017396:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017400:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017405:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017411:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017415:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017420:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017424:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017430:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017435:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017439:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017444:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017448:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017453:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017458:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017462:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017467:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017471:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017476:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017481:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017486:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017491:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017496:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017501:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017506:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017522:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017527:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017532:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017537:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017542:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017547:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017553:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017557:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017562:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017567:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017572:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017577:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017581:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017586:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017591:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017596:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017600:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017604:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017609:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017710:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017718:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017722:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017727:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017732:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017736:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017741:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017747:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017752:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017756:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017761:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017766:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017771:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017776:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017781:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017786:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017800:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518172.017804:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.018367:0:5823:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff99ffc64c5600:5823] 1 exiting: rc = 0 00000100:00100000:1.0:1789518172.018482:0:5822:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff99ffc64c5a00:5822] 0 exiting: rc = 1 00000100:00100000:2.0:1789518172.018562:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.018569:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.018574:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.018579:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.018585:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.018590:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.018595:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.018600:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.018604:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.018635:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.018642:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.018648:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.018654:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.018659:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.018664:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.019805:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.019811:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.019817:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.019821:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.019837:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.019842:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.019847:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.019852:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.019857:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.019861:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.019866:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.019871:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.019876:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.019881:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.019886:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.019891:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.019896:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.019904:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.019909:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.019918:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.019932:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.019937:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.019943:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.019947:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.019952:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.019957:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.019962:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.019967:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.019972:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.019977:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.019982:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.019988:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.019993:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.019998:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.020004:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.020010:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.020019:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.020028:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.020037:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.020043:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.020052:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.020059:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.020069:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.020077:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.020086:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.020094:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.020102:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.020110:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.020119:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518172.020956:0:5824:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff99ffc64c5e00:5824] 0 exiting: rc = 1 00000100:00100000:3.0:1789518172.020997:0:5826:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff99ffc64c4e00:5826] 2 exiting: rc = 0 00000100:00100000:1.0:1789518172.021040:0:5825:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff99ffc64c4200:5825] 1 exiting: rc = 0 00000100:00100000:2.0:1789518172.021140:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021146:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021151:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021168:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021173:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021178:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021190:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021198:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021206:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021215:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021222:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021227:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021232:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021237:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021245:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021250:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021255:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021260:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021265:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021271:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021276:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021281:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021287:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021293:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021298:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021304:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021310:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021332:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021340:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021345:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021350:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021355:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021360:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021365:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021370:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021375:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021380:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021385:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021389:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021394:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021400:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021412:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021417:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021422:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021428:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021434:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021440:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021445:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021450:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021455:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021460:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021480:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021487:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021493:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021498:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021503:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021509:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021514:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021520:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021525:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021530:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021536:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021541:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518172.021546:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789518172.027771:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789518172.027783:0:13012:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1789518172.027788:0:13012:0:(genops.c:885:class_export_put()) final put ffff99ffc7709800/MDS_uuid 00000020:00000080:3.0:1789518172.027793:0:13012:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc7709800/MDS_uuid for MDS 00000020:01000000:3.0:1789518172.027798:0:13012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1789518172.028118:0:13012:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1789518172.594777:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518172.786845:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789518172.786873:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:824c8f07-28fa-48fd-81af-173b194570e6:3282:1876445627485952:0@lo:400:kworker.0 00000100:00100000:1.0:1789518172.786878:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627486208:0@lo:400:kworker.0 00000100:00100000:0.0:1789518172.786970:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627486080:0@lo:400:kworker.0 00000400:00000100:3.0:1789518172.787112:0:3282:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876445627485952 offset 0 length 224: 4 00000400:00000100:1.0:1789518172.787158:0:3281:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876445627486208 offset 0 length 224: 4 00000400:00000100:0.0:1789518172.788673:0:3280:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876445627486080 offset 0 length 224: 4 00000001:00100000:2.0:1789518173.327672:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789518173.327680:0:6674:0:(genops.c:885:class_export_put()) final put ffff99ffff795000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789518173.327705:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cfa1c47d-1425-4fe5-be2a-28ad5152a12d 00000020:00000080:2.0:1789518173.327708:0:6674:0:(genops.c:885:class_export_put()) final put ffff99ffd80fa800/cfa1c47d-1425-4fe5-be2a-28ad5152a12d 00000020:00000080:0.0:1789518173.327762:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffff795000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789518173.327829:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffd80fa800/cfa1c47d-1425-4fe5-be2a-28ad5152a12d for lustre-OST0000 00000020:00000080:0.0:1789518173.327858:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffff796800 for lustre-OST0000 00000020:00000080:0.0:1789518173.327865:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffd80f8000 for lustre-OST0000 00000020:01000004:3.0:1789518173.569133:0:13164:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789518173.577833:0:13164:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1789518173.577908:0:13164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc28cc00/0x631fd8698c780c8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780c94 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518173.577926:0:13164:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc28cc00/0x631fd8698c780c8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780c94 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518173.577934:0:13164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc28cc00/0x631fd8698c780c8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c780c94 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518173.577942:0:13164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99fffc28cc00/0x631fd8698c780c8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c780c94 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518173.577972:0:13164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789518173.577979:0:13164:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789518173.578010:0:13164:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789518173.578024:0:13164:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99fec2975c00 x1876445627486080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518188 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518173.578070:0:13164:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00010000:00010000:2.0:1789518173.578072:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:3.0:1789518173.578078:0:13164:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00010000:00010000:2.0:1789518173.578083:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99fffc28cc00/0x631fd8698c780c8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c780c94 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518173.578093:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28cc00 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:2.0:1789518173.578104:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99fffc28cc00/0x631fd8698c780c8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c780c94 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789518173.578110:0:13164:0:(import.c:65:import_set_state_nolock()) ffff99ffffa5b800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1789518173.578115:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99fffc28cc00/0x631fd8698c780c8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c780c94 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518173.578126:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99fffc28cc00/0x631fd8698c780c8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c780c94 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518173.578134:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789518173.578207:0:5801:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00000100:00100000:0.0:1789518173.578213:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627486080:0@lo:400:kworker.0 10000000:01000000:2.0:1789518173.578215:0:5801:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:1.0:1789518173.578258:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3279:1876445627486336:0@lo:39:umount.0 00010000:00010000:2.0:1789518173.578262:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99fffc28cc00/0x631fd8698c780c8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c780c94 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518173.578276:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789518173.578309:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99fffc28cc00/0x631fd8698c780c8d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c780c94 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518173.578319:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99fffc28cc00/0x631fd8698c780c8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c780c94 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518173.578325:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000400:00000100:1.0:1789518173.578329:0:3279:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876445627486336 offset 0 length 224: 4 00000100:00100000:0.0:1789518173.578345:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:824c8f07-28fa-48fd-81af-173b194570e6:3283:1876445627486464:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789518173.578359:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518173.578365:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518173.578367:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518173.578423:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518173.578807:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627486464 00000100:00100000:1.0:1789518173.578826:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627486464 00000100:00100000:1.0:1789518173.578890:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789518173.578897:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3283:x1876445627486464:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789518173.578905:0:5797:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789518173 with bad export cookie 7142665481872738636 00000100:00100000:1.0:1789518173.585139:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3283:x1876445627486464:12345-0@lo:103:ldlm_bl.0 Request processed in 6234us (6715us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789518173.585153:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1789518173.585430:0:3283:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.151@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789518173.585437:0:3283:0:(import.c:65:import_set_state_nolock()) ffff99ffc7707000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1789518173.585442:0:3283:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.151@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1789518173.591143:0:3283:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.151@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1789518173.591148:0:3283:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789518173.591158:0:3283:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99fec2976a00 x1876445627485952/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789518188 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518173.591187:0:3283:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99fff7a7b480 x1876445627486464/t0(0) o103->MGC192.168.206.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789518189 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789518173.591197:0:3283:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789518173.591199:0:3283:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789518173.591201:0:3283:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789518173.591204:0:3283:0:(import.c:65:import_set_state_nolock()) ffff99ffc7707000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789518173.591208:0:3283:0:(import.c:545:import_select_connection()) MGC192.168.206.151@tcp: connect to NID 0@lo last attempt 93 00000100:00080000:0.0:1789518173.591221:0:3283:0:(import.c:666:import_select_connection()) MGC192.168.206.151@tcp: import ffff99ffc7707000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1789518173.591250:0:3283:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fec1b9c380 x1876445627486592/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789518173.591284:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:824c8f07-28fa-48fd-81af-173b194570e6:3283:1876445627486464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518173.591381:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:824c8f07-28fa-48fd-81af-173b194570e6:3282:1876445627485952:0@lo:400:kworker.0 00000100:00100000:2.0:1789518173.591507:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:824c8f07-28fa-48fd-81af-173b194570e6:3279:1876445627486592:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:2.0:1789518173.591558:0:3279:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876445627486592 offset 0 length 520: 4 00010000:00010000:3.0:1789518173.618731:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518174.643201:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518175.667197:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518176.690925:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518177.714904:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789518177.912182:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 824c8f07-28fa-48fd-81af-173b194570e6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789518177.912191:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 824c8f07-28fa-48fd-81af-173b194570e6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789518177.912295:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789518177.912316:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627486720:0@lo:400:kworker.0 00000400:00000100:1.0:1789518177.912368:0:3282:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876445627486720 offset 0 length 224: 4 00010000:00010000:0.0:1789518178.738820:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789518178.930723:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 824c8f07-28fa-48fd-81af-173b194570e6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789518178.930731:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 824c8f07-28fa-48fd-81af-173b194570e6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789518178.930829:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789518178.930854:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627486848:0@lo:400:kworker.0 00000400:00000100:1.0:1789518178.930909:0:3281:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876445627486848 offset 0 length 224: 4 00010000:00010000:2.0:1789518179.762766:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518180.786988:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518181.810884:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518182.835522:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518183.026759:0:3279:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789518173/real 1789518173] req@ffff99fec1b9c380 x1876445627486592/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789518183 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518183.026802:0:3279:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99fec1b9c380 x1876445627486592/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789518183 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518183.026813:0:3279:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789518173/real 1789518173] req@ffff99fff4b1f800 x1876445627486336/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789518183 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518183.026848:0:3279:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99fff4b1f800 x1876445627486336/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789518183 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789518183.026866:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffc7707000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789518183.026890:0:3279:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1789518183.026894:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:824c8f07-28fa-48fd-81af-173b194570e6:3279:1876445627486592:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:1.0:1789518183.026901:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffffa5b800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1789518183.026930:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 824c8f07-28fa-48fd-81af-173b194570e6->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789518183.026936:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1789518183.026939:0:8:0:(import.c:65:import_set_state_nolock()) ffff99ffc7707000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789518183.026944:0:8:0:(import.c:545:import_select_connection()) MGC192.168.206.151@tcp: connect to NID 0@lo last attempt 227 00000100:00080000:3.0:1789518183.026949:0:8:0:(import.c:630:import_select_connection()) MGC192.168.206.151@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789518183.026958:0:8:0:(import.c:666:import_select_connection()) MGC192.168.206.151@tcp: import ffff99ffc7707000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1789518183.026981:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3279:1876445627486336:0@lo:39:umount.0 00000100:00100000:3.0:1789518183.026987:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fff4b1c000 x1876445627486976/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789518183.027011:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:824c8f07-28fa-48fd-81af-173b194570e6:3279:1876445627486976:0@lo:250:kworker.0 00000100:00100000:3.0:1789518183.027051:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000400:00000100:1.0:1789518183.027055:0:3279:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876445627486976 offset 0 length 520: 4 00000100:00100000:3.0:1789518183.027064:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627487104:0@lo:400:kworker.0 00000400:00000100:3.0:1789518183.027109:0:3280:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876445627487104 offset 0 length 224: 4 00000100:00080000:0.0:1789518183.027543:0:13164:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789518183.027547:0:13164:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789518183.027553:0:13164:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789518183.028744:0:13164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c780c9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780ca2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518183.028761:0:13164:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c780c9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780ca2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518183.028778:0:13164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c780c9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c780ca2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518183.028786:0:13164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c780c9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c780ca2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518183.028815:0:13164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518183.028822:0:13164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9400/0x631fd8698c780e93 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780e9a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518183.028829:0:13164:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9400/0x631fd8698c780e93 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780e9a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518183.028836:0:13164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9400/0x631fd8698c780e93 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c780e9a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518183.028842:0:13164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9400/0x631fd8698c780e93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c780e9a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518183.028924:0:13164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1789518183.028942:0:13164:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1789518183.028973:0:13164:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1789518183.028978:0:13164:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1789518183.028982:0:13164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789518183.028988:0:13164:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789518183.028992:0:13164:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff99fff4203380) has no exports 00000020:00080000:0.0:1789518183.029014:0:13164:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff99fff4203380) has no exports 00010000:00010000:1.0:1789518183.030809:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789518183.030823:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c780c9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c780ca2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518183.030835:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0c00 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:1.0:1789518183.030839:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c780c9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c780ca2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518183.030850:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c780c9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c780ca2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518183.030858:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c780c9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c780ca2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518183.030865:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789518183.030867:0:5801:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1789518183.030885:0:5801:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1789518183.030902:0:5801:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99ffc7707000 00010000:00010000:1.0:1789518183.030906:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c780c9b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c780ca2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518183.030913:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c780c9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c780ca2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518183.030928:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518183.030932:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9400/0x631fd8698c780e93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c780e9a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518183.030936:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29c9400 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:1.0:1789518183.030938:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9400/0x631fd8698c780e93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c780e9a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518183.030944:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9400/0x631fd8698c780e93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c780e9a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518183.030951:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9400/0x631fd8698c780e93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c780e9a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518183.030957:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789518183.030959:0:5801:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789518183.030961:0:5801:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789518183.030965:0:5801:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99ffc7707000 00010000:00010000:1.0:1789518183.030967:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9400/0x631fd8698c780e93 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c780e9a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518183.030973:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9400/0x631fd8698c780e93 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c780e9a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518183.030995:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518183.030997:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518183.030998:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518183.031478:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789518183.031709:0:13164:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99ffed4d35a0 - data ffff99ffd7b5e360/ffff99fff7a56800 00000020:01000000:0.0:1789518183.031868:0:13164:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99ffc6b11840 - data ffff9a0000bcf0d8/ffff99fff4b10000 00100000:10000000:0.0:1789518183.040341:0:13164:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789518183.057791:0:13164:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c780a80 00000020:00000080:3.0:1789518183.057800:0:13164:0:(genops.c:885:class_export_put()) final put ffff99ffff740800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1789518183.057828:0:13164:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ffc76f3000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1789518183.057831:0:13164:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffc76f3000 2 00000020:01000004:3.0:1789518183.057834:0:13164:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99ffc76f3000 from lustre-OST0000 00000020:00000080:3.0:1789518183.057853:0:13164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789518183.057862:0:13164:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1789518183.057865:0:13164:0:(genops.c:885:class_export_put()) final put ffff99ffff744000/lustre-OST0000_UUID 00000020:00000080:3.0:1789518183.057868:0:13164:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffff744000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1789518183.057875:0:13164:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1789518183.057911:0:13164:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1789518183.057915:0:13164:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789518183.057919:0:13164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789518183.057924:0:13164:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789518183.057930:0:13164:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff99ffffa5c000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789518183.057935:0:13164:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff99ffffa53380) has exports, disconnecting them 00000020:00080000:3.0:1789518183.057940:0:13164:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff99ffffa5c000), last request at 1789518048 00000020:00000080:3.0:1789518183.057943:0:13164:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c780aaa 00000020:00080000:3.0:1789518183.057952:0:13164:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ffffa5c000): rc 0 00000020:00000080:3.0:1789518183.057957:0:13164:0:(genops.c:885:class_export_put()) final put ffff99ffffa5c000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1789518183.058648:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffff740800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1789518183.058662:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffffa5c000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1789518183.061701:0:13164:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789518183.061708:0:13164:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789518183.061712:0:13164:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789518183.061719:0:13164:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789518183.061903:0:13164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789518183.061911:0:13164:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1789518183.061917:0:13164:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffc76f3000 1 00000020:00000080:2.0:1789518183.061924:0:13164:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c780a3a 00000020:00000080:2.0:1789518183.061932:0:13164:0:(genops.c:885:class_export_put()) final put ffff99fff4011800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1789518183.061937:0:13164:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1789518183.061941:0:13164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789518183.061945:0:13164:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789518183.061948:0:13164:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff99fff4204d40) has no exports 00000020:00000080:1.0:1789518183.062384:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffffa5b800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789518183.062391:0:8:0:(genops.c:885:class_export_put()) final put ffff99ffffa59000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1789518183.062394:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffffa59000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1789518183.062399:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1789518183.062452:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99fff4011800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789518183.077568:0:13164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789518183.077581:0:13164:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1789518183.077586:0:13164:0:(genops.c:885:class_export_put()) final put ffff99ffc76f0000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1789518183.077590:0:13164:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc76f0000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1789518183.077599:0:13164:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1789518183.077746:0:13164:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99ffc76f2000 00000020:02000400:1.0:1789518183.077801:0:13164:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1789518183.858815:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789518184.726270:0:13314:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789518184.739952:0:13314:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1789518184.740022:0:13314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1400/0x631fd8698c780c63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780c6a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518184.740037:0:13314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1400/0x631fd8698c780c63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780c6a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518184.740045:0:13314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1400/0x631fd8698c780c63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c780c6a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518184.740053:0:13314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1400/0x631fd8698c780c63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c780c6a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518184.740073:0:13314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789518184.740078:0:13314:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789518184.740096:0:13314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789518184.740106:0:13314:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99fec2977b80 x1876445627486208/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518188 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518184.740185:0:13314:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99fff4b1d180 x1876445627486720/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518193 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518184.740220:0:13314:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99fff4b1ce00 x1876445627486848/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518194 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518184.740228:0:13314:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99fff4b1ea00 x1876445627487104/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518199 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518184.740239:0:13314:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789518184.740245:0:13314:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789518184.740267:0:13314:0:(import.c:65:import_set_state_nolock()) ffff99fff7b5c800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789518184.740358:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627486720:0@lo:400:kworker.0 00000100:00100000:3.0:1789518184.740387:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627487104:0@lo:400:kworker.0 00010000:00010000:1.0:1789518184.740455:0:7595:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518184.740463:0:7595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1400/0x631fd8698c780c63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c780c6a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518184.740471:0:7595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1400 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:1.0:1789518184.740488:0:7595:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1400/0x631fd8698c780c63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c780c6a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518184.740498:0:7595:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1400/0x631fd8698c780c63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c780c6a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518184.740505:0:7595:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1400/0x631fd8698c780c63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c780c6a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518184.740522:0:7595:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789518184.740525:0:7595:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789518184.740527:0:7595:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789518184.740538:0:7595:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99ffc7707000 00010000:00010000:1.0:1789518184.740542:0:7595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1400/0x631fd8698c780c63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c780c6a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518184.740549:0:7595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1400/0x631fd8698c780c63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c780c6a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518184.740560:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518184.740562:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518184.740564:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518184.740580:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3279:1876445627487232:0@lo:39:umount.0 00000400:00000100:1.0:1789518184.741007:0:3279:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876445627487232 offset 0 length 224: 4 00000100:00100000:2.0:1789518184.742019:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627486208:0@lo:400:kworker.0 00000100:00100000:2.0:1789518184.742044:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627486848:0@lo:400:kworker.0 00010000:00010000:1.0:1789518184.882916:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518185.906829:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518186.930799:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518187.956669:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789518188.147446:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 824c8f07-28fa-48fd-81af-173b194570e6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789518188.147455:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 824c8f07-28fa-48fd-81af-173b194570e6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1789518188.981307:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518190.002769:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518191.028555:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518192.050973:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518193.075227:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789518193.266767:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 824c8f07-28fa-48fd-81af-173b194570e6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789518193.266776:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 824c8f07-28fa-48fd-81af-173b194570e6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1789518194.099873:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518194.930934:0:3279:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789518184/real 1789518184] req@ffff99fec1b9ca80 x1876445627487232/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789518194 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518194.930975:0:3279:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99fec1b9ca80 x1876445627487232/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789518194 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789518194.930993:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99fff7b5c800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789518194.931021:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3279:1876445627487232:0@lo:39:umount.0 00000100:00080000:0.0:1789518194.931130:0:13314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789518194.931148:0:13314:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789518194.931153:0:13314:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789518194.933042:0:13314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9a00/0x631fd8698c780c71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780c78 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518194.933059:0:13314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9a00/0x631fd8698c780c71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780c78 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518194.933067:0:13314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9a00/0x631fd8698c780c71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c780c78 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518194.933075:0:13314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9a00/0x631fd8698c780c71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c780c78 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518194.933099:0:13314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518194.933105:0:13314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17000/0x631fd8698c780e85 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c780e8c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518194.933112:0:13314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17000/0x631fd8698c780e85 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c780e8c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518194.933146:0:13314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17000/0x631fd8698c780e85 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c780e8c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518194.933153:0:13314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17000/0x631fd8698c780e85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c780e8c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518194.933170:0:13314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1789518194.933174:0:13314:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1789518194.933196:0:13314:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1789518194.933200:0:13314:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1789518194.933204:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789518194.933208:0:13314:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789518194.933212:0:13314:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff99fff78399c0) has no exports 00000020:00080000:0.0:1789518194.933237:0:13314:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff99fff78399c0) has no exports 00010000:00010000:3.0:1789518194.933443:0:7596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789518194.933458:0:7596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9a00/0x631fd8698c780c71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c780c78 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518194.933491:0:7596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29c9a00 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:3.0:1789518194.933496:0:7596:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9a00/0x631fd8698c780c71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c780c78 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518194.933507:0:7596:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9a00/0x631fd8698c780c71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c780c78 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518194.933515:0:7596:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9a00/0x631fd8698c780c71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c780c78 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518194.933522:0:7596:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789518194.933526:0:7596:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1789518194.933530:0:7596:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1789518194.933550:0:7596:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99ffc7707000 00010000:00010000:1.0:1789518194.933551:0:7595:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518194.933558:0:7596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9a00/0x631fd8698c780c71 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c780c78 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518194.933561:0:7595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17000/0x631fd8698c780e85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c780e8c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518194.933582:0:7596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc29c9a00/0x631fd8698c780c71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c780c78 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518194.933587:0:7595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17000 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:1.0:1789518194.933597:0:7595:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17000/0x631fd8698c780e85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c780e8c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518194.933610:0:7595:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17000/0x631fd8698c780e85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c780e8c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518194.933657:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518194.933661:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518194.933664:0:7596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:1.0:1789518194.933745:0:7595:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17000/0x631fd8698c780e85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c780e8c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518194.933752:0:7595:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789518194.933754:0:7595:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789518194.933757:0:7595:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789518194.933770:0:7595:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99ffc7707000 00010000:00010000:1.0:1789518194.933774:0:7595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17000/0x631fd8698c780e85 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c780e8c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518194.933781:0:7595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17000/0x631fd8698c780e85 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c780e8c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518194.933799:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518194.933801:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518194.933803:0:7595:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789518194.938509:0:13314:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99ffed4d3660 - data ffff99fff7f39798/ffff99ffff55fc00 00000020:01000000:0.0:1789518194.939968:0:13314:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99ffd81144e0 - data ffff99fff7e51948/ffff99ffff683c00 00100000:10000000:0.0:1789518194.951706:0:13314:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789518194.978966:0:13314:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c780b4b 00000020:00000080:2.0:1789518194.978976:0:13314:0:(genops.c:885:class_export_put()) final put ffff99fff7829800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1789518194.979032:0:13314:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ffff791800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1789518194.979037:0:13314:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffff791800 2 00000020:01000004:2.0:1789518194.979040:0:13314:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99ffff791800 from lustre-OST0001 00000020:00000080:2.0:1789518194.979061:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789518194.979080:0:13314:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1789518194.979083:0:13314:0:(genops.c:885:class_export_put()) final put ffff99fff782a000/lustre-OST0001_UUID 00000020:00000080:2.0:1789518194.979086:0:13314:0:(genops.c:844:class_export_destroy()) destroying export ffff99fff782a000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1789518194.979092:0:13314:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1789518194.979175:0:13314:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 824c8f07-28fa-48fd-81af-173b194570e6->MGS 00010000:00010000:2.0:1789518194.979189:0:13314:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9a00021c7800/0x631fd8698c780a5d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c780a64 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518194.979200:0:13314:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9a00021c7800/0x631fd8698c780a5d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c780a64 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518194.979206:0:13314:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1789518194.979208:0:13314:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1789518194.979212:0:13314:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1789518194.979223:0:13314:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99ffc7707000 00010000:00010000:2.0:1789518194.979226:0:13314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9a00021c7800/0x631fd8698c780a5d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c780a64 expref: -99 pid: 6645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518194.979241:0:13314:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1600/0x631fd8698c780ce1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c780ce8 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518194.979247:0:13314:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1600/0x631fd8698c780ce1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c780ce8 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518194.979253:0:13314:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789518194.979255:0:13314:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1789518194.979257:0:13314:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1789518194.979277:0:13314:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99ffc7707000 00010000:00010000:2.0:1789518194.979280:0:13314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1600/0x631fd8698c780ce1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c780ce8 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789518194.979295:0:13314:0:(import.c:65:import_set_state_nolock()) ffff99ffc7707000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1789518194.979304:0:13314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789518194.979306:0:13314:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789518194.979307:0:13314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789518194.979311:0:13314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789518194.979321:0:13314:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99fff4b1c000 x1876445627486976/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789518198 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789518194.979451:0:13314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789518194.979455:0:13314:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00000100:00100000:0.0:1789518194.979723:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:824c8f07-28fa-48fd-81af-173b194570e6:3279:1876445627486976:0@lo:250:kworker.0 10000000:01000000:2.0:1789518194.979790:0:13314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789518194.979797:0:13314:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c78093e 00000020:00000080:2.0:1789518194.979802:0:13314:0:(genops.c:885:class_export_put()) final put ffff99ffc770f000/824c8f07-28fa-48fd-81af-173b194570e6 00000020:00000080:1.0:1789518194.979844:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99fff7829800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1789518194.979989:0:13314:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.151@tcp (flags='') 00000020:00000080:2.0:1789518194.979995:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789518194.980000:0:13314:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.151@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789518194.980004:0:13314:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff99ffc64a4d40) has no exports 00000020:00000080:1.0:1789518194.980051:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc770f000/824c8f07-28fa-48fd-81af-173b194570e6 for MGC192.168.206.151@tcp 10000000:01000000:0.0:1789518194.980100:0:5810:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1789518194.980172:0:13314:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.151@tcp: client import never connected 00000100:00080000:2.0:1789518194.980175:0:13314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1789518194.980177:0:13314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789518194.980179:0:13314:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1789518194.980181:0:13314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789518194.980220:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789518194.980225:0:13314:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.151@tcp (uuid 824c8f07-28fa-48fd-81af-173b194570e6) 00000020:01000000:2.0:1789518194.980229:0:13314:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789518194.980232:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789518194.980235:0:13314:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789518194.980239:0:13314:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff99fff7b59800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789518194.980244:0:13314:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff99fff7838000) has exports, disconnecting them 00000020:00080000:2.0:1789518194.980248:0:13314:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff99fff7b59800), last request at 1789518058 00000020:00000080:2.0:1789518194.980252:0:13314:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c780b75 00000020:00080000:2.0:1789518194.980273:0:13314:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99fff7b59800): rc 0 00000020:00000080:2.0:1789518194.980278:0:13314:0:(genops.c:885:class_export_put()) final put ffff99fff7b59800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789518194.980479:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffc7707000 for MGC192.168.206.151@tcp 00000020:00000080:1.0:1789518194.980492:0:8:0:(genops.c:885:class_export_put()) final put ffff99ffc7705800/824c8f07-28fa-48fd-81af-173b194570e6 00000020:00000080:1.0:1789518194.980494:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc7705800/824c8f07-28fa-48fd-81af-173b194570e6 for MGC192.168.206.151@tcp 00000020:01000000:1.0:1789518194.980498:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.151@tcp (824c8f07-28fa-48fd-81af-173b194570e6) 00000020:00000080:1.0:1789518194.980752:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99fff7b59800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789518194.983751:0:13314:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789518194.983759:0:13314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789518194.983763:0:13314:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789518194.983770:0:13314:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789518194.983838:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:1.0:1789518194.983981:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99fff7b5c800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1789518194.992456:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1789518194.992694:0:7596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:1.0:1789518194.992770:0:7595:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:1.0:1789518194.992883:0:5795:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff99ffc6aee400:5795] 0 exiting: rc = 1 00000100:00100000:0.0:1789518194.993003:0:8412:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff99ffd80bbc00:8412] 2 exiting: rc = 0 00000100:00100000:0.0:1789518194.993108:0:5796:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff99ffc6aee000:5796] 1 exiting: rc = 0 00000100:00100000:1.0:1789518194.993193:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.993551:0:7597:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff99ffc6bd1400:7597] 3 exiting: rc = 0 00000100:00100000:2.0:1789518194.993600:0:5798:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff99ffc8698a00:5798] 1 exiting: rc = 0 00000100:00100000:1.0:1789518194.993696:0:5797:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff99ffdfdacc00:5797] 0 exiting: rc = 1 00000100:00100000:2.0:1789518194.995844:0:5799:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff99ffc8698800:5799] 2 exiting: rc = 0 00000100:00100000:0.0:1789518194.995943:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.995951:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.995957:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.995963:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.995968:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.995974:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.995980:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.995986:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.995991:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.995997:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996003:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996009:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996014:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996019:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996025:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996030:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996036:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996042:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996048:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996053:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996058:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996063:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996068:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996073:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996078:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996084:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996088:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996094:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996098:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996103:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996109:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996114:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996119:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996125:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996141:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996146:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996151:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996157:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996162:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996166:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996171:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996176:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996182:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996187:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996192:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996197:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996202:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996208:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996213:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996219:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996224:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996228:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996233:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996238:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996243:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996247:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996252:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996257:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996261:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996280:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996286:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996291:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996295:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518194.996301:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789518194.997187:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789518194.997196:0:13314:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1789518194.997201:0:13314:0:(genops.c:885:class_export_put()) final put ffff99fff782c000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1789518194.997206:0:13314:0:(genops.c:844:class_export_destroy()) destroying export ffff99fff782c000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1789518194.997211:0:13314:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1789518194.997256:0:13314:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffff791800 1 00000020:00000080:0.0:1789518194.997324:0:13314:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c780b1a 00000020:00000080:0.0:1789518194.997331:0:13314:0:(genops.c:885:class_export_put()) final put ffff99ffff740000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1789518194.997348:0:13314:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1789518194.997354:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789518194.997435:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffff740000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1789518194.997463:0:13314:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789518194.997467:0:13314:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff99ffd10fcd40) has no exports 00000020:00000080:1.0:1789518195.011659:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789518195.011672:0:13314:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1789518195.011677:0:13314:0:(genops.c:885:class_export_put()) final put ffff99ffd925a800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1789518195.011681:0:13314:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffd925a800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1789518195.011689:0:13314:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1789518195.011877:0:13314:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99ffd925f800 00000020:01000000:1.0:1789518195.011895:0:13314:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1789518195.011898:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789518195.011902:0:13314:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789518195.011906:0:13314:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff99ffc64a3380) has no exports 00000020:00000080:1.0:1789518195.011928:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789518195.011933:0:13314:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1789518195.011936:0:13314:0:(genops.c:885:class_export_put()) final put ffff99fff4013000/OSS_uuid 00000020:00000080:1.0:1789518195.011938:0:13314:0:(genops.c:844:class_export_destroy()) destroying export ffff99fff4013000/OSS_uuid for OSS 00000020:01000000:1.0:1789518195.011941:0:13314:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1789518195.012046:0:5808:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1789518195.012066:0:6649:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff99ffc6b81e00:6649] 2 exiting: rc = 0 00000100:00100000:3.0:1789518195.012138:0:6648:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff99fffc229200:6648] 1 exiting: rc = 0 00000100:00100000:1.0:1789518195.012210:0:8784:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff99fffc388c00:8784] 3 exiting: rc = 0 00000100:00100000:3.0:1789518195.013697:0:6647:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff99fffc228800:6647] 0 exiting: rc = 1 00000100:00100000:1.0:1789518195.013897:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.013906:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.013913:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.013917:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.013923:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.013941:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.013946:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.013951:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.013957:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.013961:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.013967:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.013972:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.013977:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.013982:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.013988:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.013993:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.013998:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014003:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014008:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014014:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014019:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014024:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014029:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014034:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014039:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014045:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014050:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014056:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014061:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014066:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014071:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014076:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014082:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014087:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014092:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014097:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014103:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014108:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014114:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014119:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014132:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014137:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014141:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014146:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014151:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014155:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014160:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014164:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014170:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014175:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014180:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014185:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014189:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014194:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014198:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014202:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014207:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014212:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014216:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014221:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014226:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014231:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014236:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.014242:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518195.015071:0:6652:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff99ffc6b81c00:6652] 1 exiting: rc = 0 00000100:00100000:3.0:1789518195.016000:0:6651:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff99ffc6b80800:6651] 0 exiting: rc = 1 00000100:00100000:1.0:1789518195.016144:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016151:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016156:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016162:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016166:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016171:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016175:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016180:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016184:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016190:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016194:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016212:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016217:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016221:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016226:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016231:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016236:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016241:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016246:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016250:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016255:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016260:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016265:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016270:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016275:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016279:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016284:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016289:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016294:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016298:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016303:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016309:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016314:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016318:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016323:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016328:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016332:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016336:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016340:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016344:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016349:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016353:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016420:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016428:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016433:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016438:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016450:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016455:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016460:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016464:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016468:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016473:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016479:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016484:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016489:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016494:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016500:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016504:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016509:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016514:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016519:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016523:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016529:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.016533:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518195.017731:0:12527:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_003: service thread [ffff99fec1143200:12527] 3 exiting: rc = 0 00000100:00100000:2.0:1789518195.017761:0:6655:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff99ffc6b80400:6655] 2 exiting: rc = 0 00000100:00100000:3.0:1789518195.018606:0:6654:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff99ffc6b80c00:6654] 1 exiting: rc = 0 00000100:00100000:2.0:1789518195.018945:0:6653:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff99ffc6b80e00:6653] 0 exiting: rc = 1 00000100:00100000:1.0:1789518195.019038:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019046:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019051:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019056:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019062:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019078:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019095:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019102:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019108:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019114:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019119:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019125:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019130:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019136:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019141:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019147:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019152:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019170:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019175:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019180:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019185:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019190:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019195:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019200:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019206:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019211:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019217:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019222:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019228:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019233:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019252:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019259:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019264:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019270:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019275:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019281:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019286:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019291:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019296:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019302:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019307:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019313:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019317:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019322:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019328:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019333:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019339:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019344:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019350:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019355:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019480:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019487:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019500:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019505:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019524:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019531:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019536:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019541:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019547:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019552:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019557:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019562:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019567:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.019573:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518195.023901:0:6656:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff99ffc4fcde00:6656] 0 exiting: rc = 1 00000100:00100000:2.0:1789518195.024003:0:6657:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff99ffd1390200:6657] 1 exiting: rc = 0 00000100:00100000:1.0:1789518195.024100:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024107:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024112:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024117:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024121:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024126:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024131:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024136:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024141:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024146:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024151:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024155:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024160:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024165:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024170:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024174:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024179:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024184:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024188:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024193:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024198:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024202:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024207:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024223:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024228:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024252:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024257:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024262:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024267:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024272:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024277:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024281:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024286:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024291:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024295:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024299:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024304:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024308:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024313:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024318:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024322:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024327:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024331:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024336:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024340:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024345:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024350:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024355:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024419:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024428:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024433:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024438:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024443:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024448:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024453:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024458:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024463:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024468:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024480:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024485:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024491:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024496:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024500:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.024505:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518195.025292:0:6658:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff99ffd32c4c00:6658] 0 exiting: rc = 1 00000100:00100000:0.0:1789518195.025453:0:6659:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff99ffdac7ce00:6659] 1 exiting: rc = 0 00000100:00100000:1.0:1789518195.025542:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025548:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025561:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025568:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025573:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025579:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025585:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025599:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025606:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025694:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025702:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025708:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025724:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025730:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025736:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025743:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025749:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025754:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025762:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025783:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025791:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025796:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025802:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025808:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025813:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025820:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025825:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025830:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025836:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025852:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025857:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025875:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025883:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025888:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025894:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025900:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025906:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025911:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025917:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025923:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025928:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025934:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025940:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025960:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025967:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025972:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025978:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025984:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025991:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.025997:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.026003:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.026009:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.026016:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.026022:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.026028:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.026050:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.026058:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.026064:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.026069:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.026076:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.026081:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.026087:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.026093:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518195.026099:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1789518195.035421:0:13314:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1789518204.342721:0:13929:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789518208.690312:0:14392:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789518208.690316:0:14392:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1789518208.690418:0:14392:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99ffd8b25000 00000020:01000004:1.0:1789518208.690432:0:14392:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1789518208.690440:0:14392:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789518208.690452:0:14392:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff99fff783cd40) 00000020:00000080:1.0:1789518208.690464:0:14392:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789518208.701441:0:14392:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1789518208.703232:0:14392:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1789518208.703708:0:14392:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1789518208.703775:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 579: rc = 0 00100000:10000000:1.0:1789518208.703905:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:1.0:1789518208.703993:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:1.0:1789518208.704077:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 579: rc = 0 00100000:10000000:1.0:1789518208.704165:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 579: rc = 0 00100000:10000000:1.0:1789518208.704250:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:1.0:1789518208.704473:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 581: rc = 0 00100000:10000000:1.0:1789518208.705562:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 390: rc = 0 00100000:10000000:1.0:1789518208.705793:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 390: rc = 0 00100000:10000000:1.0:1789518208.706312:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 398: rc = 0 00100000:10000000:1.0:1789518208.706547:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 398: rc = 0 00100000:10000000:1.0:1789518208.707481:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 398: rc = 0 00100000:10000000:1.0:1789518208.707729:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 398: rc = 0 00100000:10000000:1.0:1789518208.708019:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 398: rc = 0 00100000:10000000:1.0:1789518208.708189:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 398: rc = 0 00100000:10000000:1.0:1789518208.708370:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 398: rc = 0 00100000:10000000:1.0:1789518208.709186:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 398: rc = 0 00100000:10000000:1.0:1789518208.709362:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 398: rc = 0 00100000:10000000:1.0:1789518208.709591:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 398: rc = 0 00100000:10000000:1.0:1789518208.710010:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 398: rc = 0 00100000:10000000:1.0:1789518208.710180:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 398: rc = 0 00100000:10000000:1.0:1789518208.710513:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 166: rc = 0 00100000:10000000:1.0:1789518208.710746:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 166: rc = 0 00100000:10000000:1.0:1789518208.711051:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 166: rc = 0 00100000:10000000:1.0:1789518208.711263:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 166: rc = 0 00100000:10000000:1.0:1789518208.711465:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 166: rc = 0 00100000:10000000:1.0:1789518208.711816:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 166: rc = 0 00100000:10000000:1.0:1789518208.712045:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 166: rc = 0 00100000:10000000:1.0:1789518208.712268:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 166: rc = 0 00100000:10000000:1.0:1789518208.712506:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 166: rc = 0 00100000:10000000:1.0:1789518208.712849:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 166: rc = 0 00100000:10000000:1.0:1789518208.713076:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 166: rc = 0 00100000:10000000:1.0:1789518208.713300:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 166: rc = 0 00100000:10000000:1.0:1789518208.713534:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 166: rc = 0 00100000:10000000:1.0:1789518208.713826:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 166: rc = 0 00100000:10000000:1.0:1789518208.714055:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 166: rc = 0 00100000:10000000:1.0:1789518208.714277:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 166: rc = 0 00100000:10000000:1.0:1789518208.714507:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 166: rc = 0 00100000:10000000:1.0:1789518208.714793:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 166: rc = 0 00100000:10000000:1.0:1789518208.715026:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 166: rc = 0 00100000:10000000:1.0:1789518208.715259:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 166: rc = 0 00100000:10000000:1.0:1789518208.715539:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 166: rc = 0 00100000:10000000:1.0:1789518208.715928:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 166: rc = 0 00100000:10000000:1.0:1789518208.716103:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 166: rc = 0 00100000:10000000:1.0:1789518208.716268:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 166: rc = 0 00100000:10000000:1.0:1789518208.716832:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 166: rc = 0 00100000:10000000:1.0:1789518208.717273:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 166: rc = 0 00100000:10000000:1.0:1789518208.717523:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 166: rc = 0 00100000:10000000:1.0:1789518208.717796:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 166: rc = 0 00100000:10000000:1.0:1789518208.718076:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 166: rc = 0 00100000:10000000:1.0:1789518208.718339:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 166: rc = 0 00100000:10000000:1.0:1789518208.718589:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 166: rc = 0 00100000:10000000:1.0:1789518208.719082:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 166: rc = 0 00100000:10000000:1.0:1789518208.719572:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 155: rc = 0 00100000:10000000:1.0:1789518208.720217:0:14392:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1789518208.720384:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 391: rc = 0 00100000:10000000:1.0:1789518208.721000:0:14392:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1789518208.721062:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 391: rc = 0 00100000:10000000:1.0:1789518208.721236:0:14392:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1789518208.721295:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 391: rc = 0 00100000:10000000:1.0:1789518208.722571:0:14392:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1789518208.722786:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 395: rc = 0 00100000:10000000:1.0:1789518208.722991:0:14392:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1789518208.723061:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 395: rc = 0 00100000:10000000:1.0:1789518208.723252:0:14392:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1789518208.723321:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 395: rc = 0 00000020:00000080:1.0:1789518208.723792:0:14392:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1789518208.723798:0:14392:0:(osd_handler.c:1614:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789518208.723805:0:14392:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c781c3f 00000020:01000004:1.0:1789518208.723811:0:14392:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1789518208.723814:0:14392:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1789518208.723817:0:14392:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99ffd8b25000 from MGS 00000020:01000004:1.0:1789518208.723824:0:14392:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1789518208.723831:0:14392:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff99fff783b380) 00000020:00000080:1.0:1789518208.723838:0:14392:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1789518208.723895:0:14392:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ffd8b25000 from MGS, refs=2 00080000:01000000:1.0:1789518208.723900:0:14392:0:(osd_handler.c:1614:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789518208.723905:0:14392:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c781c4d 00000100:00100000:1.0:1789518208.723986:0:14392:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1789518208.724070:0:14392:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1789518208.724074:0:14392:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789518208.724388:0:14392:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789518208.724399:0:14392:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789518208.725073:0:14392:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789518208.725207:0:14392:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789518208.725212:0:14392:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789518208.726073:0:14392:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789518208.726081:0:14392:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789518208.726418:0:14392:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789518208.726424:0:14392:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789518208.727281:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518208.727284:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518208.727286:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518208.727544:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518208.727547:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518208.727548:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518208.728109:0:14392:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789518208.730717:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789518208.737664:0:14392:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1789518208.737679:0:14392:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789518208.737681:0:14392:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1789518208.739019:0:14401:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789518208.739164:0:14392:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789518208.739279:0:14392:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789518208.739880:0:14392:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789518208.740296:0:14392:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789518208.740509:0:14392:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789518208.740516:0:14392:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789518208.741000:0:14392:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789518208.741007:0:14392:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789518208.741858:0:14392:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789518208.741865:0:14392:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:3.0:1789518208.742772:0:14406:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1789518208.742877:0:14392:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789518208.742897:0:14392:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.151@tcp' 00000020:01000004:1.0:1789518208.742898:0:14392:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789518208.742925:0:14392:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.151@tcp (typ=mgc) 00000020:00000080:1.0:1789518208.742937:0:14392:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.151@tcp (ffff99fff7838000) 00000020:00000080:1.0:1789518208.742951:0:14392:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789518208.743018:0:14392:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ffd925e000@MGC192.168.206.151@tcp: add connection 192.168.206.151@tcp at head 00010000:00010000:1.0:1789518208.743161:0:14392:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.151@tcp-0 is initialized 00000040:01000000:1.0:1789518208.743166:0:14392:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 1 is initialized 10000000:01000000:1.0:1789518208.746287:0:14407:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789518208.746992:0:14392:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.151@tcp (uuid 8a262dbd-f283-43e3-b7fd-ac44d37658cb) 00000020:00000080:0.0:1789518208.747009:0:14392:0:(genops.c:1384:class_connect()) connect: client 8a262dbd-f283-43e3-b7fd-ac44d37658cb, cookie 0x631fd8698c781c5b 00000100:00080000:0.0:1789518208.747018:0:14392:0:(import.c:545:import_select_connection()) MGC192.168.206.151@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789518208.747027:0:14392:0:(import.c:666:import_select_connection()) MGC192.168.206.151@tcp: import ffff99ffd925e000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1789518208.747110:0:14392:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fec1b9d500 x1876445627487360/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789518208.747130:0:14392:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 8a262dbd-f283-43e3-b7fd-ac44d37658cb->MGS 00000020:01000004:0.0:1789518208.747151:0:14392:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789518208.747156:0:14392:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789518208.747167:0:14392:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff99ffffa519c0) 00000100:00100000:1.0:1789518208.747168:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8a262dbd-f283-43e3-b7fd-ac44d37658cb:3279:1876445627487360:0@lo:250:mount.lustre.0 00000020:00000080:0.0:1789518208.747177:0:14392:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789518208.747226:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518208.748758:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627487360 00000100:00100000:2.0:1789518208.748769:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627487360 00000100:00100000:2.0:1789518208.748808:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789518208.748815:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff422b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3279:x1876445627487360:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1789518208.748838:0:14404:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 8a262dbd-f283-43e3-b7fd-ac44d37658cb@0@lo t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:2.0:1789518208.748863:0:14404:0:(genops.c:1384:class_connect()) connect: client 8a262dbd-f283-43e3-b7fd-ac44d37658cb, cookie 0x631fd8698c781c69 00000100:00080000:2.0:1789518208.748975:0:14404:0:(import.c:65:import_set_state_nolock()) ffff99ffed4ef000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789518208.749046:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff422b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+5:3279:x1876445627487360:12345-0@lo:250:mount.lustre.0 Request processed in 229us (1818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518208.749054:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789518208.749841:0:3279:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.151@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789518208.749853:0:3279:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.206.151@tcp: connect to target with instance 0 00000100:00080000:1.0:1789518208.749869:0:3279:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.206.151@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789518208.749873:0:3279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789518208.749877:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffd925e000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789518208.749880:0:3279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789518208.749890:0:3279:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789518208.749896:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8a262dbd-f283-43e3-b7fd-ac44d37658cb:3279:1876445627487360:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789518208.755962:0:14392:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789518208.756145:0:14392:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789518208.756152:0:14392:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789518208.757004:0:14392:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789518208.757011:0:14392:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789518208.757334:0:14392:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789518208.757340:0:14392:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789518208.758044:0:14392:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789518208.758195:0:14392:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789518208.758200:0:14392:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789518208.758597:0:14392:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789518208.758604:0:14392:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789518208.781390:0:14392:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789518208.781529:0:14392:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789518208.781534:0:14392:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789518208.782266:0:14392:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789518208.782272:0:14392:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789518208.782897:0:14392:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789518208.783061:0:14392:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789518208.783066:0:14392:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789518208.785105:0:14392:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789518208.785114:0:14392:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789518208.785605:0:14392:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789518208.785954:0:14392:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789518208.785959:0:14392:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789518208.786307:0:14392:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789518208.786313:0:14392:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789518208.786935:0:14392:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789518208.787068:0:14392:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789518208.787074:0:14392:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789518208.787602:0:14392:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789518208.787768:0:14392:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789518208.800844:0:14392:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789518208.801023:0:14392:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789518208.801029:0:14392:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789518208.802240:0:14392:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789518208.802248:0:14392:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789518208.803210:0:14392:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789518208.803218:0:14392:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789518208.803922:0:14392:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789518208.803943:0:14392:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1789518208.803949:0:14392:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.151@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789518208.804071:0:14392:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789518208.804104:0:14392:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.151@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1789518208.804108:0:14392:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789518208.804110:0:14392:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789518208.804111:0:14392:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518208.804113:0:14392:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518208.804114:0:14392:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518208.804120:0:14392:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518208.804121:0:14392:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789518208.804123:0:14392:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789518208.804124:0:14392:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518208.804125:0:14392:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789518208.804128:0:14392:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1789518208.804130:0:14392:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789518208.804131:0:14392:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789518208.804132:0:14392:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518208.804133:0:14392:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518208.804134:0:14392:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518208.804135:0:14392:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518208.804136:0:14392:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789518208.804137:0:14392:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789518208.804137:0:14392:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518208.804138:0:14392:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789518208.804172:0:14392:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789518208.804190:0:14392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14392:1876445627487488:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789518208.804255:0:14392:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518208.804348:0:14392:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc2af1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789518208.804455:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627487488 00000100:00100000:3.0:1789518208.804461:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627487488 00000100:00100000:3.0:1789518208.804533:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789518208.804542:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff422b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+5:14392:x1876445627487488:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789518208.804584:0:14405:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789518208.804588:0:14405:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789518208.804590:0:14405:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1789518208.804917:0:14425:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789518208.805248:0:14405:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1789518208.806137:0:14426:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1789518208.806142:0:14426:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1789518208.806144:0:14426:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1789518208.806181:0:14426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1789518208.806422:0:14405:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789518208.806430:0:14405:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789518208.814511:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff422b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+5:14392:x1876445627487488:12345-0@lo:253:mount.lustre.0 Request processed in 9962us (10247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518208.814552:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789518208.814680:0:14392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14392:1876445627487488:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789518208.814695:0:14392:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789518208.814699:0:14392:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789518208.814700:0:14392:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789518208.814702:0:14392:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518208.814703:0:14392:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518208.814704:0:14392:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518208.814705:0:14392:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518208.814706:0:14392:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789518208.814707:0:14392:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789518208.814708:0:14392:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518208.814709:0:14392:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789518208.814730:0:14392:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99ffd8b25000 from lustre-MDT0000 10000000:01000000:1.0:1789518208.814747:0:14392:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789518208.814749:0:14392:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789518208.814753:0:14392:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff99fff7838000 10000000:01000000:1.0:1789518208.814757:0:14392:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789518208.814768:0:14392:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99fff7838000 from 1 10000000:01000000:1.0:1789518208.814770:0:14392:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789518208.814798:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7a00/0x631fd8698c781c70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518208.814805:0:14392:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7a00/0x631fd8698c781c70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518208.814812:0:14392:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7a00/0x631fd8698c781c70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518208.814825:0:14392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14392:1876445627487616:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789518208.814849:0:14392:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518208.814877:0:14392:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee58ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1789518208.815084:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627487616 00000100:00100000:2.0:1789518208.815091:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627487616 00000100:00100000:2.0:1789518208.815137:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789518208.815150:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff422b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+5:14392:x1876445627487616:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789518208.815163:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518208.815178:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffd0697600/0x631fd8698c781c77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c781c70 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518208.815202:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffd0697600/0x631fd8698c781c77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c781c70 expref: 6 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518208.815213:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffd0697600/0x631fd8698c781c77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c781c70 expref: 6 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518208.815222:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697600, rc 0) 00000100:00100000:2.0:1789518208.815266:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff422b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+6:14392:x1876445627487616:12345-0@lo:101:mount.lustre.0 Request processed in 122us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518208.815273:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789518208.815699:0:14392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14392:1876445627487616:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518208.815712:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7a00/0x631fd8698c781c70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781c77 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518208.815722:0:14392:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7a00/0x631fd8698c781c70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c781c77 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518208.815764:0:14392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14392:1876445627487744:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518208.815788:0:14392:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518208.815813:0:14392:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee58ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1789518208.816492:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627487744 00000100:00100000:3.0:1789518208.816498:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627487744 00000100:00100000:3.0:1789518208.816540:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789518208.816548:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+6:14392:x1876445627487744:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518208.816836:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+6:14392:x1876445627487744:12345-0@lo:501:mount.lustre.0 Request processed in 287us (1046us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789518208.816843:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789518208.817662:0:14392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14392:1876445627487744:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789518208.817697:0:14392:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789518208.817718:0:14392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7a00/0x631fd8698c781c70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781c77 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518208.817741:0:14392:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7a00/0x631fd8698c781c70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781c77 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518208.817750:0:14392:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99ffd8b25000 10000000:01000000:1.0:1789518208.817754:0:14392:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789518208.817758:0:14392:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99ffd8b25000 10000000:01000000:1.0:1789518208.817761:0:14392:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789518208.817763:0:14392:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff99ffd8b25000 from 1 10000000:01000000:1.0:1789518208.817766:0:14392:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789518208.817789:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc2f6e00/0x631fd8698c781c7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518208.817796:0:14392:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fffc2f6e00/0x631fd8698c781c7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518208.817804:0:14392:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fffc2f6e00/0x631fd8698c781c7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518208.817818:0:14392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14392:1876445627487872:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789518208.817853:0:14392:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518208.817936:0:14392:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee58ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518208.817984:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627487872 00000100:00100000:0.0:1789518208.817995:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627487872 00000100:00100000:0.0:1789518208.818036:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789518208.818045:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4229050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+6:14392:x1876445627487872:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789518208.818055:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518208.818068:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffed5bda00/0x631fd8698c781c85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c781c7e expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518208.818086:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bda00/0x631fd8698c781c85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c781c7e expref: 7 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518208.818094:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffed5bda00/0x631fd8698c781c85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c781c7e expref: 7 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518208.818101:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bda00, rc 0) 00000100:00100000:0.0:1789518208.818237:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4229050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+7:14392:x1876445627487872:12345-0@lo:101:mount.lustre.0 Request processed in 193us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518208.818243:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789518208.818293:0:14392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14392:1876445627487872:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518208.818305:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fffc2f6e00/0x631fd8698c781c7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781c85 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518208.818314:0:14392:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fffc2f6e00/0x631fd8698c781c7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c781c85 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518208.818335:0:14392:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789518208.818345:0:14392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc2f6e00/0x631fd8698c781c7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781c85 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518208.818351:0:14392:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fffc2f6e00/0x631fd8698c781c7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781c85 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518208.818358:0:14392:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789518208.818361:0:14392:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789518208.818366:0:14392:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99ffd8b25000 10000000:01000000:1.0:1789518208.818369:0:14392:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789518208.818373:0:14392:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789518208.818375:0:14392:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789518208.818390:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7200/0x631fd8698c781c8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518208.818397:0:14392:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7200/0x631fd8698c781c8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518208.818404:0:14392:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7200/0x631fd8698c781c8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518208.818416:0:14392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14392:1876445627488000:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789518208.818440:0:14392:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518208.818462:0:14392:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee58ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1789518208.818516:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627488000 00000100:00100000:3.0:1789518208.818520:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627488000 00000100:00100000:3.0:1789518208.818547:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789518208.818553:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff422a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+7:14392:x1876445627488000:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518208.818560:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518208.818570:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc6b17a00/0x631fd8698c781c93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c781c8c expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518208.818585:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc6b17a00/0x631fd8698c781c93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c781c8c expref: 8 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518208.818593:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc6b17a00/0x631fd8698c781c93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c781c8c expref: 8 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518208.818600:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17a00, rc 0) 00000100:00100000:3.0:1789518208.818726:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff422a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+8:14392:x1876445627488000:12345-0@lo:101:mount.lustre.0 Request processed in 173us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518208.818732:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789518208.818806:0:14392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14392:1876445627488000:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518208.818815:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7200/0x631fd8698c781c8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781c93 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518208.818828:0:14392:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7200/0x631fd8698c781c8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c781c93 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518208.818868:0:14392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14392:1876445627488128:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518208.818889:0:14392:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518208.818941:0:14392:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee58ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518208.818976:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627488128 00000100:00100000:0.0:1789518208.818980:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627488128 00000100:00100000:0.0:1789518208.819003:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789518208.819009:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff422ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+8:14392:x1876445627488128:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789518208.819376:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff422ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+9:14392:x1876445627488128:12345-0@lo:501:mount.lustre.0 Request processed in 366us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518208.819383:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789518208.819432:0:14392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14392:1876445627488128:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518208.819457:0:14392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14392:1876445627488256:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518208.819495:0:14392:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518208.819518:0:14392:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee58ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1789518208.819578:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627488256 00000100:00100000:3.0:1789518208.819587:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627488256 00000100:00100000:2.0:1789518208.819661:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789518208.819671:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4228850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+9:14392:x1876445627488256:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789518208.819987:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4228850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+9:14392:x1876445627488256:12345-0@lo:503:mount.lustre.0 Request processed in 317us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518208.819994:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789518208.820026:0:14392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14392:1876445627488256:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789518208.820390:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a79880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14427:1876445627488384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789518208.820425:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518208.820452:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff40c56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518208.820467:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627488384 00000100:00100000:0.0:1789518208.820473:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627488384 00000100:00100000:0.0:1789518208.820506:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789518208.820513:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe0149050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+9:14427:x1876445627488384:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518208.820789:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe0149050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+9:14427:x1876445627488384:12345-0@lo:502:llog_process_th.0 Request processed in 276us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518208.820796:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789518208.820965:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a79880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14427:1876445627488384:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789518208.820987:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789518208.820996:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518208.820998:0:14427:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789518208.821003:0:14427:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789518208.821005:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789518208.821029:0:14427:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff99fff42019c0) 00000020:00000080:2.0:1789518208.821044:0:14427:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789518208.821049:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789518208.821116:0:14427:0:(osd_handler.c:1614:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789518208.821123:0:14427:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c781ca1 00000020:00000080:2.0:1789518208.821342:0:14427:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789518208.821346:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789518208.821350:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518208.821352:0:14427:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789518208.821355:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789518208.821358:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518208.821360:0:14427:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789518208.821363:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789518208.821370:0:14427:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff99fff4204d40) 00000020:00000080:2.0:1789518208.821379:0:14427:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789518208.821383:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789518208.821385:0:14427:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789518208.821394:0:14427:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789518208.821400:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789518208.821441:0:14427:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ffd8b25000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789518208.821453:0:14427:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff99fff4203380) 00000020:00000080:2.0:1789518208.821461:0:14427:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789518208.821505:0:14427:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789518208.821510:0:14427:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x631fd8698c781cb6 00000020:00000080:2.0:1789518208.821606:0:14427:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789518208.821633:0:14427:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789518208.821639:0:14427:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x631fd8698c781cbd 00080000:01000000:2.0:1789518208.821656:0:14427:0:(osd_handler.c:1614:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789518208.821660:0:14427:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c781cc4 00010000:00010000:3.0:1789518208.864478:0:14427:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1789518208.867487:0:14427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1789518208.868551:0:14427:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789518208.870060:0:14427:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff99ffc64a3380) 00000020:00000080:3.0:1789518208.870134:0:14427:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789518208.870445:0:14427:0:(osd_handler.c:1614:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789518208.870454:0:14427:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c781cd2 00000020:00000080:3.0:1789518208.871264:0:14427:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789518208.877677:0:14427:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x631fd8698c781cd9 00000020:00000080:3.0:1789518208.877976:0:14427:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789518208.877986:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518208.877992:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518208.877994:0:14427:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789518208.877997:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518208.878003:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518208.878004:0:14427:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789518208.878008:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789518208.878038:0:14427:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789518208.878048:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518208.878051:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518208.878053:0:14427:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789518208.878055:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789518208.878057:0:14427:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:3.0:1789518208.878059:0:14427:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789518208.878060:0:14427:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789518208.878062:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789518208.878064:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518208.878066:0:14427:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789518208.878068:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789518208.878071:0:14427:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789518208.878074:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518208.878080:0:14427:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789518208.878084:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789518208.878089:0:14427:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:01000000:3.0:1789518208.878111:0:14427:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789518208.878113:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789518208.878125:0:14427:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99ffc64a4d40) 00000020:00000080:3.0:1789518208.878138:0:14427:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1789518208.878142:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789518208.878188:0:14427:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789518208.878193:0:14427:0:(osd_handler.c:1614:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789518208.878198:0:14427:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c781ce7 00010000:00080000:3.0:1789518208.878224:0:14427:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99fff7b5e800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:3.0:1789518208.878439:0:14427:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1789518208.878788:0:14427:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789518208.878828:0:14427:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789518208.879704:0:14427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789518208.879781:0:14427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1789518208.879862:0:14427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1789518208.880412:0:14431:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789518208.880417:0:14431:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789518208.881217:0:14427:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789518208.881228:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789518208.881256:0:14427:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789518208.881273:0:14427:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x631fd8698c781cee 00000100:00080000:0.0:1789518208.881282:0:14427:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789518208.881292:0:14427:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99fff7b5e800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1789518208.881325:0:14427:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fec1b9e300 x1876445627488512/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789518208.881388:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627488512:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789518208.881434:0:3279:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876445627488512 offset 0 length 520: 4 00000100:00080000:0.0:1789518208.881491:0:14427:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789518208.881547:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518208.881551:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518208.881553:0:14427:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789518208.881556:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789518208.881558:0:14427:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:0.0:1789518208.881560:0:14427:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789518208.881562:0:14427:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789518208.881563:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789518208.881566:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518208.881567:0:14427:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789518208.881569:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789518208.881573:0:14427:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789518208.881576:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518208.881577:0:14427:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789518208.881580:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789518208.881584:0:14427:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:01000000:0.0:1789518208.881601:0:14427:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789518208.881604:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789518208.881657:0:14427:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99ffffa50000) 00000020:00000080:0.0:1789518208.881669:0:14427:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1789518208.881674:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789518208.881728:0:14427:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789518208.881733:0:14427:0:(osd_handler.c:1614:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789518208.881739:0:14427:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c781cfc 00010000:00080000:0.0:1789518208.881777:0:14427:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ffd1033000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:0.0:1789518208.881972:0:14427:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1789518208.882121:0:14427:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789518208.882140:0:14427:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789518208.882639:0:14427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789518208.882714:0:14427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1789518208.882784:0:14427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1789518208.883402:0:14433:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789518208.883406:0:14433:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789518208.884225:0:14427:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789518208.884234:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789518208.884262:0:14427:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789518208.884279:0:14427:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x631fd8698c781d03 00000100:00080000:3.0:1789518208.884288:0:14427:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789518208.884297:0:14427:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99ffd1033000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1789518208.884326:0:14427:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fff4b1ea00 x1876445627488640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789518208.884354:0:14427:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1789518208.884433:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627488640:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789518208.884478:0:3279:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876445627488640 offset 0 length 520: 4 00000020:01000000:3.0:1789518208.884573:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518208.884582:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518208.884584:0:14427:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789518208.884588:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518208.884591:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518208.884592:0:14427:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789518208.884595:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789518208.884597:0:14427:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789518208.884599:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518208.884601:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518208.884602:0:14427:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789518208.884605:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518208.884607:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518208.884609:0:14427:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789518208.884652:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789518208.884680:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14427:1876445627488768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518208.884731:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518208.884759:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee68c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518208.884893:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627488768 00000100:00100000:1.0:1789518208.884899:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627488768 00000100:00100000:1.0:1789518208.884943:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789518208.884951:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe014ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+9:14427:x1876445627488768:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518208.885165:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe014ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+9:14427:x1876445627488768:12345-0@lo:502:llog_process_th.0 Request processed in 214us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518208.885172:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789518208.885257:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14427:1876445627488768:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789518208.885281:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518208.885285:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518208.885286:0:14427:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789518208.885290:0:14427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1789518208.885422:0:14392:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1789518208.885444:0:14392:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789518208.885465:0:14392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7200/0x631fd8698c781c8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781c93 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518208.885475:0:14392:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7200/0x631fd8698c781c8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781c93 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518208.885482:0:14392:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99ffd8b25000 from 1 10000000:01000000:1.0:1789518208.885485:0:14392:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789518208.885507:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc2f6000/0x631fd8698c781d0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518208.885514:0:14392:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fffc2f6000/0x631fd8698c781d0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518208.885523:0:14392:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fffc2f6000/0x631fd8698c781d0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518208.885536:0:14392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14392:1876445627488896:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789518208.885562:0:14392:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518208.885588:0:14392:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee58e180 going to sleep for 11 seconds 00000100:00100000:0.0:1789518208.885735:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627488896 00000100:00100000:0.0:1789518208.885740:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627488896 00000100:00100000:0.0:1789518208.885843:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789518208.885852:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe014bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+9:14392:x1876445627488896:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789518208.885861:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518208.885873:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffed5bdc00/0x631fd8698c781d11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c781d0a expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518208.885894:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bdc00/0x631fd8698c781d11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c781d0a expref: 10 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518208.885904:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffed5bdc00/0x631fd8698c781d11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c781d0a expref: 10 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518208.885913:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bdc00, rc 0) 00000100:00100000:0.0:1789518208.886016:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe014bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+10:14392:x1876445627488896:12345-0@lo:101:mount.lustre.0 Request processed in 165us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518208.886029:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789518208.886142:0:14392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14392:1876445627488896:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518208.886155:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fffc2f6000/0x631fd8698c781d0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781d11 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518208.886164:0:14392:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fffc2f6000/0x631fd8698c781d0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c781d11 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518208.886741:0:14392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14392:1876445627489024:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789518208.886892:0:14392:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518208.886955:0:14392:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee58e180 going to sleep for 11 seconds 00000100:00100000:2.0:1789518208.886993:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627489024 00000100:00100000:2.0:1789518208.886998:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627489024 00000100:00100000:2.0:1789518208.887063:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789518208.887070:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe014a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+10:14392:x1876445627489024:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789518208.887085:0:14403:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789518208.887091:0:14403:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789518208.887161:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe014a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+10:14392:x1876445627489024:12345-0@lo:256:mount.lustre.0 Request processed in 91us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518208.887167:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789518208.887223:0:14392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14392:1876445627489024:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789518208.887803:0:14392:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789518208.887816:0:14392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc2f6000/0x631fd8698c781d0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781d11 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518208.887826:0:14392:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fffc2f6000/0x631fd8698c781d0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781d11 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518208.887834:0:14392:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ffd8b25000 from 1 10000000:01000000:1.0:1789518208.887841:0:14392:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789518208.887863:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7000/0x631fd8698c781d18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518208.887871:0:14392:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7000/0x631fd8698c781d18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518208.887879:0:14392:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7000/0x631fd8698c781d18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518208.887893:0:14392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14392:1876445627489152:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789518208.887921:0:14392:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518208.887952:0:14392:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee58e180 going to sleep for 11 seconds 00000100:00100000:3.0:1789518208.888111:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627489152 00000100:00100000:3.0:1789518208.888116:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627489152 00000100:00100000:3.0:1789518208.888152:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789518208.888159:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe0148c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+10:14392:x1876445627489152:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518208.888167:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518208.888178:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc6b16800/0x631fd8698c781d1f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c781d18 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518208.888194:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc6b16800/0x631fd8698c781d1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c781d18 expref: 11 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518208.888211:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc6b16800/0x631fd8698c781d1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c781d18 expref: 11 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518208.888218:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16800, rc 0) 00000100:00100000:3.0:1789518208.888257:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe0148c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+11:14392:x1876445627489152:12345-0@lo:101:mount.lustre.0 Request processed in 99us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518208.888263:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789518208.888369:0:14392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14392:1876445627489152:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518208.888381:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7000/0x631fd8698c781d18 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781d1f expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518208.888399:0:14392:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7000/0x631fd8698c781d18 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c781d1f expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518208.888440:0:14392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14392:1876445627489280:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518208.888462:0:14392:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518208.888484:0:14392:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee58e180 going to sleep for 11 seconds 00000100:00100000:3.0:1789518208.888503:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627489280 00000100:00100000:3.0:1789518208.888508:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627489280 00000100:00100000:0.0:1789518208.888565:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789518208.888574:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe0149450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+11:14392:x1876445627489280:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789518208.889219:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe0149450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+11:14392:x1876445627489280:12345-0@lo:501:mount.lustre.0 Request processed in 646us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518208.889226:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789518208.889308:0:14392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14392:1876445627489280:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518208.889336:0:14392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14392:1876445627489408:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518208.889371:0:14392:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518208.889387:0:14392:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee58e180 going to sleep for 11 seconds 00000100:00100000:2.0:1789518208.889486:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627489408 00000100:00100000:2.0:1789518208.889491:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627489408 00000100:00100000:2.0:1789518208.889570:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789518208.889578:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe014b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+11:14392:x1876445627489408:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789518208.889971:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe014b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+11:14392:x1876445627489408:12345-0@lo:503:mount.lustre.0 Request processed in 393us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518208.889978:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789518208.890042:0:14392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14392:1876445627489408:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789518208.890363:0:14435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14435:1876445627489536:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518208.890397:0:14435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518208.890462:0:14435:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee68c840 going to sleep for 11 seconds 00000100:00100000:0.0:1789518208.890493:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627489536 00000100:00100000:0.0:1789518208.890497:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627489536 00000100:00100000:0.0:1789518208.890555:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789518208.890562:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe0149850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+11:14435:x1876445627489536:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518208.890921:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe0149850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+11:14435:x1876445627489536:12345-0@lo:502:llog_process_th.0 Request processed in 359us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518208.890928:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789518208.890996:0:14435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14435:1876445627489536:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789518208.891025:0:14435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789518208.891032:0:14435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518208.891034:0:14435:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789518208.891041:0:14435:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ffd8b25000 00000020:00000080:2.0:1789518208.891043:0:14435:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789518208.891050:0:14435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789518208.891053:0:14435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518208.891054:0:14435:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789518208.891056:0:14435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789518208.891059:0:14435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518208.891060:0:14435:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789518208.891064:0:14435:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ffd8b25000 00000020:00000080:2.0:1789518208.891066:0:14435:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789518208.891122:0:14435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789518208.891126:0:14435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518208.891127:0:14435:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789518208.891130:0:14435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789518208.891132:0:14435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518208.891133:0:14435:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789518208.891136:0:14435:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99ffd8b25000 00000020:00000080:2.0:1789518208.891138:0:14435:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789518208.891170:0:14435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a79880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14435:1876445627489664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789518208.891204:0:14435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518208.897484:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627489664 00000100:00100000:3.0:1789518208.897498:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627489664 00000100:00100000:2.0:1789518208.897569:0:14435:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff40c5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789518208.897631:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789518208.897654:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe014a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+11:14435:x1876445627489664:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518208.897896:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe014a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+11:14435:x1876445627489664:12345-0@lo:502:llog_process_th.0 Request processed in 256us (6690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518208.897904:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789518208.898739:0:14435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a79880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14435:1876445627489664:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789518208.898846:0:14435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789518208.898854:0:14435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518208.898857:0:14435:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789518208.898862:0:14435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789518208.899010:0:14392:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1789518208.899028:0:14392:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789518208.899045:0:14392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7000/0x631fd8698c781d18 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781d1f expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518208.899057:0:14392:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7000/0x631fd8698c781d18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781d1f expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518208.899096:0:14392:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789518208.899099:0:14392:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99ffd8b25000 10000000:01000000:1.0:1789518208.899103:0:14392:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99ffd8b25000 10000000:01000000:1.0:1789518208.899119:0:14392:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789518208.899125:0:14392:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99ffd8b25000 from 1 10000000:01000000:1.0:1789518208.899127:0:14392:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789518208.899155:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc2f6400/0x631fd8698c781d26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518208.899169:0:14392:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fffc2f6400/0x631fd8698c781d26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518208.899180:0:14392:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fffc2f6400/0x631fd8698c781d26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518208.899199:0:14392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14392:1876445627489792:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789518208.899243:0:14392:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518208.899283:0:14392:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee58e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518208.899499:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627489792 00000100:00100000:2.0:1789518208.899511:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627489792 00000100:00100000:2.0:1789518208.899555:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789518208.899565:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe0149c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+11:14392:x1876445627489792:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789518208.899575:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518208.899587:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffd0696a00/0x631fd8698c781d2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c781d26 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518208.899607:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffd0696a00/0x631fd8698c781d2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c781d26 expref: 12 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518208.899655:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffd0696a00/0x631fd8698c781d2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c781d26 expref: 12 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518208.899663:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696a00, rc 0) 00000100:00100000:2.0:1789518208.899696:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe0149c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+12:14392:x1876445627489792:12345-0@lo:101:mount.lustre.0 Request processed in 134us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518208.899702:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789518208.899868:0:14392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14392:1876445627489792:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518208.899881:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fffc2f6400/0x631fd8698c781d26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781d2d expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518208.899890:0:14392:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fffc2f6400/0x631fd8698c781d26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c781d2d expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518208.899937:0:14392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14392:1876445627489920:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518208.899960:0:14392:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518208.899989:0:14392:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee58e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518208.900032:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627489920 00000100:00100000:2.0:1789518208.900037:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627489920 00000100:00100000:2.0:1789518208.900068:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789518208.900075:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe014a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+12:14392:x1876445627489920:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789518208.900302:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe014a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+12:14392:x1876445627489920:12345-0@lo:501:mount.lustre.0 Request processed in 227us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518208.900309:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789518208.900341:0:14392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14392:1876445627489920:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789518208.900369:0:14392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14392:1876445627490048:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789518208.900407:0:14392:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518208.900424:0:14392:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff40c5780 going to sleep for 11 seconds 00000100:00100000:1.0:1789518208.900869:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627490048 00000100:00100000:1.0:1789518208.900876:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627490048 00000100:00100000:1.0:1789518208.900900:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789518208.900906:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe0148450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+12:14392:x1876445627490048:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518208.901041:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe0148450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+12:14392:x1876445627490048:12345-0@lo:503:mount.lustre.0 Request processed in 135us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518208.901047:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789518208.901164:0:14392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14392:1876445627490048:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789518208.901834:0:14439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14439:1876445627490176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518208.901876:0:14439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518208.901909:0:14439:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd9134180 going to sleep for 11 seconds 00000100:00100000:1.0:1789518208.901958:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627490176 00000100:00100000:1.0:1789518208.901963:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627490176 00000100:00100000:1.0:1789518208.901993:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789518208.901999:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe014b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+12:14439:x1876445627490176:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518208.902169:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe014b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+12:14439:x1876445627490176:12345-0@lo:502:llog_process_th.0 Request processed in 169us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518208.902176:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789518208.902281:0:14439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14439:1876445627490176:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1789518208.902332:0:14439:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789518208.902346:0:14439:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff99ffffa54d40) 00000020:00000080:0.0:1789518208.902362:0:14439:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1789518208.902432:0:14439:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ffd8b25000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789518208.902436:0:14439:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ffd8b25000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789518208.902438:0:14439:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffd8b25000 4 00010000:00080000:0.0:1789518208.902463:0:14439:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99fff7b5d800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:0.0:1789518208.905290:0:14439:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1789518208.905633:0:14439:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789518208.905683:0:14439:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789518208.905696:0:14439:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x631fd8698c781d3b 00000100:00080000:0.0:1789518208.905707:0:14439:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789518208.905720:0:14439:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99fff7b5d800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1789518208.905757:0:14439:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fec1b9f480 x1876445627490304/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789518208.905996:0:14439:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789518208.915722:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876445627490304:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789518208.915792:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518208.915864:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627490304 00000100:00100000:3.0:1789518208.915873:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627490304 00000100:00100000:3.0:1789518208.915904:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789518208.915910:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3279:x1876445627490304:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789518208.915975:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3279:x1876445627490304:12345-0@lo:38:llog_process_th.0 Request processed in 63us (181us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789518208.915982:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789518208.916016:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789518208.916024:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99fff7b5d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789518208.916029:0:3279:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789518208.916033:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876445627490304:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789518208.917140:0:14439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14439:1876445627490432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518208.917195:0:14439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518208.917228:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627490432 00000100:00100000:0.0:1789518208.917233:0:14439:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff4047b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789518208.917235:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627490432 00000100:00100000:2.0:1789518208.917282:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789518208.917290:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe014b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+12:14439:x1876445627490432:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789518208.918443:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe014b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+12:14439:x1876445627490432:12345-0@lo:502:llog_process_th.0 Request processed in 1150us (1246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518208.918454:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789518208.918478:0:14439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14439:1876445627490432:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789518208.918505:0:14439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789518208.918741:0:14392:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789518208.918761:0:14392:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789518208.919014:0:14392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc2f6400/0x631fd8698c781d26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781d2d expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518208.919025:0:14392:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fffc2f6400/0x631fd8698c781d26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781d2d expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789518208.919143:0:14392:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789518208.919146:0:14392:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789518208.919147:0:14392:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789518208.919148:0:14392:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789518208.919150:0:14392:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789518208.919151:0:14392:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789518208.919152:0:14392:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789518208.919154:0:14392:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789518208.919156:0:14392:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789518208.919158:0:14392:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789518208.919162:0:14392:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1789518208.919165:0:14392:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789518208.919166:0:14392:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789518208.919168:0:14392:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789518208.919169:0:14392:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789518208.919170:0:14392:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789518208.919172:0:14392:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789518208.919173:0:14392:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789518208.919174:0:14392:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789518208.919176:0:14392:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789518208.919177:0:14392:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789518208.919201:0:14392:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789518208.919214:0:14392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14392:1876445627490560:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789518208.919322:0:14392:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518208.919355:0:14392:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff4047b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789518208.920128:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627490560 00000100:00100000:2.0:1789518208.920136:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627490560 00000100:00100000:2.0:1789518208.920181:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789518208.920191:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed7c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+12:14392:x1876445627490560:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789518208.920216:0:14403:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789518208.920227:0:14403:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789518208.953002:0:14403:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789518208.953019:0:14403:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789518208.953121:0:14425:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789518208.953126:0:14425:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789518208.953147:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ffd0697c00/0x631fd8698c781d42 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518208.953165:0:14425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffed5bdc00/0x631fd8698c781d11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c781d0a expref: 12 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518208.953175:0:14425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ffd0697c00/0x631fd8698c781d42 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518208.953212:0:14425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffed5bdc00/0x631fd8698c781d11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c781d0a expref: 12 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518208.953226:0:14425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ffed5bdc00/0x631fd8698c781d11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c781d0a expref: 12 pid: 14405 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518208.953252:0:14425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a79880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14425:1876445627490688:0@lo:104: 00000100:00100000:2.0:1789518208.953855:0:14425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518208.953958:0:14425:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff40c5540 going to sleep for 11 seconds 00000100:00100000:3.0:1789518208.954016:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627490688 00000100:00100000:3.0:1789518208.954024:0:14393:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627490688 00000100:00100000:3.0:1789518208.954068:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789518208.954077:0:14393:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+3:14425:x1876445627490688:12345-0@lo:104: 00010000:00010000:3.0:1789518208.954090:0:14393:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99fffc2f6000/0x631fd8698c781d0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c781d11 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518208.954197:0:14393:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789518208.954203:0:14393:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+3:14425:x1876445627490688:12345-0@lo:104: Request processed in 128us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518208.954210:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789518208.954338:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518208.954346:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99fffc2f6000/0x631fd8698c781d0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c781d11 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518208.954355:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f6000 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:0.0:1789518208.954359:0:14399:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99fffc2f6000/0x631fd8698c781d0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c781d11 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518208.954381:0:14399:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99fffc2f6000/0x631fd8698c781d0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c781d11 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518208.954388:0:14399:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99fffc2f6000/0x631fd8698c781d0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c781d11 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518208.954394:0:14399:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789518208.954473:0:14399:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99fffc2f6000/0x631fd8698c781d0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c781d11 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518208.954478:0:14399:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789518208.954498:0:14425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a79880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14425:1876445627490688:0@lo:104: 00010000:00010000:0.0:1789518208.954498:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99fffc2f6000/0x631fd8698c781d0a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c781d11 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518208.954509:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99fffc2f6000/0x631fd8698c781d0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c781d11 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518208.954521:0:14425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ffd0697c00/0x631fd8698c781d42 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518208.954523:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518208.954525:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518208.954526:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518208.954545:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a262dbd-f283-43e3-b7fd-ac44d37658cb:3282:1876445627490816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518208.954571:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518208.954607:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627490816 00000100:00100000:2.0:1789518208.954652:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627490816 00010000:00010000:2.0:1789518208.954672:0:14395:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffed5bdc00/0x631fd8698c781d11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c781d0a expref: 13 pid: 14405 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518208.954698:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789518208.954706:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+13:3282:x1876445627490816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789518208.954716:0:14395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518208.954721:0:14395:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffed5bdc00/0x631fd8698c781d11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c781d0a expref: 13 pid: 14405 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518208.954731:0:14395:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffed5bdc00/0x631fd8698c781d11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c781d0a expref: 13 pid: 14405 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518208.954744:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffed5bdc00/0x631fd8698c781d11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c781d0a expref: 13 pid: 14405 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518208.954758:0:14395:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ffd0697c00/0x631fd8698c781d42 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518208.954766:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffd0697c00/0x631fd8698c781d42 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789518208.954784:0:14395:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001658770s 00010000:00010000:2.0:1789518208.954788:0:14395:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffd0697c00/0x631fd8698c781d42 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518208.954794:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffd0697c00/0x631fd8698c781d42 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518208.954800:0:14395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ffd0697c00/0x631fd8698c781d42 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518208.954805:0:14395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ffd0697c00/0x631fd8698c781d42 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518208.954810:0:14395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697c00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518208.954813:0:14395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ffd0697c00/0x631fd8698c781d42 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518208.954820:0:14395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ffd0697c00/0x631fd8698c781d42 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518208.954835:0:14395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ffd0697c00/0x631fd8698c781d42 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518208.954844:0:14395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518208.954863:0:14425:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ffd0697c00/0x631fd8698c781d42 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518208.954873:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ffd0697c00/0x631fd8698c781d42 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518208.954880:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffd0697c00/0x631fd8698c781d42 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518208.954886:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+12:3282:x1876445627490816:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518208.954901:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789518208.954952:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a262dbd-f283-43e3-b7fd-ac44d37658cb:3282:1876445627490816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518208.962081:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed7c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+11:14392:x1876445627490560:12345-0@lo:253:mount.lustre.0 Request processed in 41884us (42750us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518208.962095:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789518208.962241:0:14392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14392:1876445627490560:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789518208.962255:0:14392:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789518208.962258:0:14392:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789518208.962259:0:14392:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789518208.962261:0:14392:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789518208.962262:0:14392:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789518208.962263:0:14392:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789518208.962264:0:14392:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789518208.962265:0:14392:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789518208.962266:0:14392:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789518208.962268:0:14392:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789518208.962269:0:14392:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789518208.962282:0:14392:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789518208.966451:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1789518208.966709:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789518208.966984:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1789518208.967140:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789518208.967441:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1789518208.967708:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1789518208.971751:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1789518208.971920:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1789518208.972183:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1789518208.972388:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1789518208.973904:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1789518208.974234:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1789518208.997846:0:14392:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1789518208.998178:0:14392:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1789518208.998417:0:14447:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1789518208.998421:0:14447:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1789518208.998506:0:14448:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1789518208.998567:0:14448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789518209.000937:0:14448:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789518209.000999:0:14448:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:2.0:1789518209.001003:0:14448:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:0.0:1789518209.001729:0:14392:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789518209.001845:0:14392:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789518209.002276:0:14392:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789518209.002282:0:14392:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789518209.002839:0:14392:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789518209.004333:0:14392:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789518209.005353:0:14392:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789518209.005390:0:14392:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1789518209.005929:0:14392:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:0.0:1789518209.006890:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1789518209.010552:0:14392:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1789518209.030811:0:14392:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789518209.030897:0:14392:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa50841c8f988 00100000:10000000:3.0:1789518209.030903:0:14392:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789518209.031276:0:14392:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789518209.031290:0:14392:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.151@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789518209.031306:0:14392:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1789518209.031328:0:14392:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1789518209.779598:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789518209.970794:0:14407:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789518209.970801:0:14407:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99ffd8b25000 from 6 10000000:01000000:1.0:1789518209.970806:0:14407:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789518209.970844:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7c00/0x631fd8698c781d49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518209.970856:0:14407:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7c00/0x631fd8698c781d49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518209.970867:0:14407:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7c00/0x631fd8698c781d49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518209.970889:0:14407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2974700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14407:1876445627490944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789518209.970954:0:14407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518209.971037:0:14407:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc9184840 going to sleep for 11 seconds 00000100:00100000:3.0:1789518209.971747:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627490944 00000100:00100000:3.0:1789518209.971765:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627490944 00000100:00100000:3.0:1789518209.971817:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789518209.971828:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed7c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+11:14407:x1876445627490944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518209.971842:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518209.971862:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc6b17000/0x631fd8698c781d50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c781d49 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518209.971886:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc6b17000/0x631fd8698c781d50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c781d49 expref: 12 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518209.971897:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc6b17000/0x631fd8698c781d50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c781d49 expref: 12 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518209.971906:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17000, rc 0) 00000100:00100000:3.0:1789518209.971969:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed7c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+12:14407:x1876445627490944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518209.971976:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000040:00080000:2.0:1789518209.972314:0:14443:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789518209.972320:0:14443:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518209.972709:0:14443:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1789518209.972715:0:14443:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789518209.973180:0:14407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2974700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14407:1876445627490944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518209.973201:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7c00/0x631fd8698c781d49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781d50 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518209.973217:0:14407:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7c00/0x631fd8698c781d49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c781d50 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518209.973280:0:14407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14407:1876445627491072:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789518209.973328:0:14407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518209.973369:0:14407:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789518209.974760:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627491072 00000100:00100000:3.0:1789518209.974770:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627491072 00000100:00100000:3.0:1789518209.974812:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789518209.974822:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed7c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+12:14407:x1876445627491072:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789518209.974841:0:14403:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789518209.974856:0:14403:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789518209.974859:0:14403:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1789518209.974977:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed7c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+12:14407:x1876445627491072:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 156us (1648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518209.974985:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789518209.975042:0:14407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14407:1876445627491072:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789518209.975089:0:14407:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789518209.975098:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7c00/0x631fd8698c781d49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781d50 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518209.975108:0:14407:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7c00/0x631fd8698c781d49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781d50 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518210.802827:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789518210.994831:0:14443:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789518210.994839:0:14443:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518210.994871:0:14443:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1789518210.994878:0:14443:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:02000400:1.0:1789518211.313585:0:14690:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789518211.827785:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789518212.831306:0:14841:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd342d7150 20000000:00000080:3.0:1789518212.831321:0:14841:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99fff588ec00 uarg=0000000000000000 20000000:01000000:3.0:1789518212.831352:0:14841:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789518212.831358:0:14841:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789518212.831362:0:14841:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789518212.832295:0:14842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1789518212.832371:0:14841:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789518212.837411:0:14841:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789518212.837438:0:14841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ffc6b17800/0x631fd8698c781d57 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518212.837455:0:14841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffc6b16800/0x631fd8698c781d1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c781d18 expref: 11 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518212.837462:0:14841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ffc6b17800/0x631fd8698c781d57 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518212.837499:0:14841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffc6b16800/0x631fd8698c781d1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c781d18 expref: 11 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518212.837511:0:14841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ffc6b16800/0x631fd8698c781d1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c781d18 expref: 11 pid: 14405 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518212.837523:0:14841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14841:1876445627491200:0@lo:104: 00000100:00100000:3.0:1789518212.837575:0:14841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518212.837673:0:14841:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc9247000 going to sleep for 11 seconds 00000100:00100000:1.0:1789518212.837676:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627491200 00000100:00100000:1.0:1789518212.837685:0:14393:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627491200 00000100:00100000:1.0:1789518212.837737:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789518212.837747:0:14393:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+3:14841:x1876445627491200:12345-0@lo:104: 00010000:00010000:1.0:1789518212.837759:0:14393:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7000/0x631fd8698c781d18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c781d1f expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518212.837820:0:14393:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789518212.837837:0:14393:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+3:14841:x1876445627491200:12345-0@lo:104: Request processed in 93us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518212.837845:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1789518212.837875:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518212.837881:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7000/0x631fd8698c781d18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c781d1f expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518212.837898:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7000 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:1.0:1789518212.837902:0:14399:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7000/0x631fd8698c781d18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c781d1f expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518212.837915:0:14399:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7000/0x631fd8698c781d18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c781d1f expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518212.837922:0:14399:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7000/0x631fd8698c781d18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c781d1f expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518212.837927:0:14399:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789518212.837961:0:14399:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7000/0x631fd8698c781d18 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c781d1f expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518212.837962:0:14841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14841:1876445627491200:0@lo:104: 00010000:00010000:1.0:1789518212.837978:0:14399:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518212.837984:0:14841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ffc6b17800/0x631fd8698c781d57 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518212.837999:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7000/0x631fd8698c781d18 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c781d1f expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518212.838007:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7000/0x631fd8698c781d18 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c781d1f expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518212.838016:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1789518212.838025:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518212.838027:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a262dbd-f283-43e3-b7fd-ac44d37658cb:3282:1876445627491328:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789518212.838029:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518212.838033:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518212.838055:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518212.838734:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627491328 00000100:00100000:1.0:1789518212.838740:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627491328 00010000:00010000:1.0:1789518212.838761:0:14397:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffc6b16800/0x631fd8698c781d1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c781d18 expref: 12 pid: 14405 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518212.838844:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789518212.838871:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+12:3282:x1876445627491328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789518212.838882:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518212.838888:0:14397:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffc6b16800/0x631fd8698c781d1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c781d18 expref: 12 pid: 14405 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518212.838899:0:14397:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffc6b16800/0x631fd8698c781d1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c781d18 expref: 12 pid: 14405 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518212.838912:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b16800/0x631fd8698c781d1f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c781d18 expref: 12 pid: 14405 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518212.838926:0:14397:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ffc6b17800/0x631fd8698c781d57 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518212.838934:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc6b17800/0x631fd8698c781d57 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518212.838947:0:14397:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffc6b17800/0x631fd8698c781d57 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518212.838954:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffc6b17800/0x631fd8698c781d57 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518212.838961:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ffc6b17800/0x631fd8698c781d57 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518212.838968:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ffc6b17800/0x631fd8698c781d57 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518212.838974:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518212.838977:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ffc6b17800/0x631fd8698c781d57 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518212.838991:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ffc6b17800/0x631fd8698c781d57 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518212.839007:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ffc6b17800/0x631fd8698c781d57 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518212.839018:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518212.839062:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+11:3282:x1876445627491328:12345-0@lo:103:ldlm_bl.0 Request processed in 194us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518212.839069:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789518212.839132:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a262dbd-f283-43e3-b7fd-ac44d37658cb:3282:1876445627491328:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789518212.839279:0:14841:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ffc6b17800/0x631fd8698c781d57 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518212.839288:0:14841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ffc6b17800/0x631fd8698c781d57 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518212.839302:0:14841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b17800/0x631fd8698c781d57 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518212.852287:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518213.877403:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789518214.260136:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518214.260148:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789518214.260150:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518214.260153:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789518214.260155:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00100000:1.0:1789518214.260157:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a262dbd-f283-43e3-b7fd-ac44d37658cb:3280:1876445627491456:0@lo:400:kworker.0 00000100:00080000:3.0:1789518214.260158:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789518214.260161:0:36:0:(import.c:65:import_set_state_nolock()) ffff99fff7b5d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789518214.260173:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99fff7b5d800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1789518214.260192:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fff4b1e300 x1876445627491584/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789518214.260216:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518214.260252:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627491456 00000100:00100000:3.0:1789518214.260258:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627491456 00000100:00100000:1.0:1789518214.260260:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876445627491584:0@lo:38:kworker.0 00000100:00100000:1.0:1789518214.260289:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518214.260321:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627491584 00000100:00100000:2.0:1789518214.260325:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627491584 00000100:00100000:2.0:1789518214.260355:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789518214.260362:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3279:x1876445627491584:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789518214.260384:0:14411:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:2.0:1789518214.260415:0:14411:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x631fd8698c781d5e 00000004:00100000:2.0:1789518214.260429:0:14411:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789518214.260543:0:14411:0:(import.c:65:import_set_state_nolock()) ffff99ffedb73800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789518214.260591:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876445627491584:12345-0@lo:38:kworker.0 Request processed in 227us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518214.260599:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789518214.260660:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99fff4b1e300 x1876445627491584/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789518224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789518214.260674:0:3279:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789518214.260680:0:3279:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789518214.260684:0:3279:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789518214.260686:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99fff7b5d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789518214.260691:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876445627491584:0@lo:38:kworker.0 00000100:00100000:3.0:1789518214.261059:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789518214.261069:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed7c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+11:3280:x1876445627491456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518214.261124:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed7c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+11:3280:x1876445627491456:12345-0@lo:400:kworker.0 Request processed in 57us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518214.261130:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789518214.261162:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a262dbd-f283-43e3-b7fd-ac44d37658cb:3280:1876445627491456:0@lo:400:kworker.0 10000000:01000000:0.0:1789518214.770737:0:14407:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789518214.770820:0:14407:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ffd8b25000 from 10 10000000:01000000:0.0:1789518214.770825:0:14407:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789518214.770880:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc800/0x631fd8698c781d65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518214.770892:0:14407:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc800/0x631fd8698c781d65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518214.770903:0:14407:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc800/0x631fd8698c781d65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518214.770929:0:14407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14407:1876445627491712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789518214.771014:0:14407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518214.771071:0:14407:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc3387900 going to sleep for 11 seconds 00000100:00100000:1.0:1789518214.771672:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627491712 00000100:00100000:1.0:1789518214.771681:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627491712 00000100:00100000:1.0:1789518214.771738:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789518214.771749:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed7c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+11:14407:x1876445627491712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518214.771763:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518214.771779:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc2f7000/0x631fd8698c781d6c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c781d65 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518214.771802:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc2f7000/0x631fd8698c781d6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c781d65 expref: 12 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518214.771824:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc2f7000/0x631fd8698c781d6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c781d65 expref: 12 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518214.771833:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f7000, rc 0) 00000100:00100000:1.0:1789518214.771889:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed7c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+12:14407:x1876445627491712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518214.771896:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789518214.772178:0:14407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14407:1876445627491712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789518214.772194:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc800/0x631fd8698c781d65 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781d6c expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518214.772209:0:14407:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc800/0x631fd8698c781d65 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c781d6c expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518214.772266:0:14407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a79880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14407:1876445627491840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789518214.772294:0:14407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518214.772327:0:14407:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffdb5dcf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518214.772381:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627491840 00000100:00100000:0.0:1789518214.772386:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627491840 00000100:00100000:0.0:1789518214.772417:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789518214.772424:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed7c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+12:14407:x1876445627491840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518214.772729:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed7c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+12:14407:x1876445627491840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 299us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518214.772737:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789518214.772826:0:14407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a79880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14407:1876445627491840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789518214.772853:0:14407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a79880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14407:1876445627491968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789518214.772888:0:14407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518214.772913:0:14407:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffdb5dcf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789518214.772963:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627491968 00000100:00100000:1.0:1789518214.772967:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627491968 00000100:00100000:1.0:1789518214.772992:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789518214.772999:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed7c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+12:14407:x1876445627491968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518214.773151:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed7c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+12:14407:x1876445627491968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518214.773159:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789518214.773174:0:14407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a79880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14407:1876445627491968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789518214.774167:0:15017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789518214.774445:0:14407:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789518214.774467:0:14407:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789518214.774476:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc800/0x631fd8698c781d65 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781d6c expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518214.774487:0:14407:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc800/0x631fd8698c781d65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781d6c expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518214.899095:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789518215.502354:0:15090:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789518215.502358:0:15090:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789518215.502482:0:15090:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99ffedb71000 00000020:01000004:2.0:1789518215.502496:0:15090:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789518215.502506:0:15090:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789518215.502519:0:15090:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff99fff4200000) 00000020:00000080:2.0:1789518215.502542:0:15090:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789518215.514312:0:15090:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789518215.514576:0:15090:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789518215.515461:0:15090:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789518215.515786:0:15090:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789518215.516775:0:15090:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789518215.517112:0:15090:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1789518215.517239:0:15090:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1789518215.517328:0:15090:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1789518215.517840:0:15090:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 769: rc = 0 00100000:10000000:2.0:1789518215.518081:0:15090:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 769: rc = 0 00100000:10000000:2.0:1789518215.518406:0:15090:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 769: rc = 0 00100000:10000000:2.0:1789518215.518701:0:15090:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:2.0:1789518215.519561:0:15090:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 769: rc = 0 00100000:10000000:2.0:1789518215.519929:0:15090:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 769: rc = 0 00000020:00000080:2.0:1789518215.520464:0:15090:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789518215.520474:0:15090:0:(osd_handler.c:1614:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789518215.520484:0:15090:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x631fd8698c781d7a 00000020:01000004:2.0:1789518215.520491:0:15090:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789518215.520510:0:15090:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.151@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789518215.520513:0:15090:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789518215.520518:0:15090:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789518215.520522:0:15090:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789518215.520533:0:15090:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff99ffd10fcd40) 00000020:00000080:2.0:1789518215.520542:0:15090:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1789518215.521559:0:15090:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789518215.521803:0:15090:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789518215.521809:0:15090:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789518215.522297:0:15090:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789518215.522304:0:15090:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789518215.522571:0:15090:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789518215.522576:0:15090:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789518215.524165:0:15090:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789518215.524320:0:15090:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789518215.524325:0:15090:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789518215.525060:0:15090:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789518215.525067:0:15090:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789518215.544351:0:15090:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789518215.544756:0:15090:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789518215.544763:0:15090:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789518215.546112:0:15090:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789518215.546122:0:15090:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789518215.547148:0:15090:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789518215.547158:0:15090:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789518215.549186:0:15090:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789518215.549455:0:15090:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789518215.549461:0:15090:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789518215.549979:0:15090:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789518215.549986:0:15090:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1789518215.579777:0:15090:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789518215.579978:0:15090:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1789518215.579984:0:15090:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1789518215.581002:0:15090:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1789518215.581012:0:15090:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1789518215.581418:0:15090:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1789518215.581443:0:15090:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1789518215.581449:0:15090:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.151@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789518215.592287:0:15090:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789518215.592324:0:15090:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.151@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1789518215.592329:0:15090:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789518215.592331:0:15090:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789518215.592332:0:15090:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789518215.592333:0:15090:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789518215.592335:0:15090:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789518215.592336:0:15090:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789518215.592337:0:15090:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789518215.592339:0:15090:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789518215.592340:0:15090:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789518215.592343:0:15090:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1789518215.592345:0:15090:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789518215.592346:0:15090:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789518215.592348:0:15090:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789518215.592349:0:15090:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789518215.592349:0:15090:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789518215.592356:0:15090:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789518215.592356:0:15090:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789518215.592357:0:15090:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789518215.592358:0:15090:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789518215.592386:0:15090:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789518215.592404:0:15090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15090:1876445627492096:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789518215.592480:0:15090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518215.592557:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627492096 00000100:00100000:2.0:1789518215.592564:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627492096 00000100:00100000:0.0:1789518215.592573:0:15090:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789518215.592695:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789518215.592707:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed7c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+12:15090:x1876445627492096:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789518215.592736:0:14405:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789518215.592739:0:14405:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1789518215.592743:0:14405:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789518215.601095:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed7c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+12:15090:x1876445627492096:12345-0@lo:253:mount.lustre.0 Request processed in 8380us (8604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518215.601108:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789518215.601200:0:15090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15090:1876445627492096:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789518215.601213:0:15090:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789518215.601216:0:15090:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789518215.601217:0:15090:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789518215.601219:0:15090:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789518215.601220:0:15090:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789518215.601221:0:15090:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789518215.601222:0:15090:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789518215.601223:0:15090:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789518215.601225:0:15090:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789518215.601226:0:15090:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789518215.601245:0:15090:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99ffedb71000 from lustre-OST0000 10000000:01000000:0.0:1789518215.601265:0:15090:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789518215.601268:0:15090:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789518215.601274:0:15090:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99fff7838000 local copy 00010000:00010000:0.0:1789518215.601284:0:15090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7a00/0x631fd8698c781c70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781c77 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518215.601475:0:15090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15090:1876445627492224:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789518215.601506:0:15090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518215.601545:0:15090:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518215.601709:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627492224 00000100:00100000:1.0:1789518215.601716:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627492224 00000100:00100000:1.0:1789518215.601762:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789518215.601771:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed7c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+12:15090:x1876445627492224:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518215.601918:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed7c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+12:15090:x1876445627492224:12345-0@lo:501:mount.lustre.0 Request processed in 148us (410us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789518215.601926:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789518215.601950:0:15090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15090:1876445627492224:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789518215.601966:0:15090:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789518215.602103:0:15090:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789518215.602114:0:15090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7a00/0x631fd8698c781c70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781c77 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518215.602177:0:15090:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7a00/0x631fd8698c781c70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781c77 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518215.602196:0:15090:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99ffedb71000 10000000:01000000:0.0:1789518215.602201:0:15090:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789518215.602205:0:15090:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff99fff7838000 10000000:01000000:0.0:1789518215.602207:0:15090:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789518215.602210:0:15090:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff99fff7838000 from 1 10000000:01000000:0.0:1789518215.602213:0:15090:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789518215.602234:0:15090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd800/0x631fd8698c781d88 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518215.602241:0:15090:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd800/0x631fd8698c781d88 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518215.602250:0:15090:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd800/0x631fd8698c781d88 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518215.602263:0:15090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15090:1876445627492352:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789518215.602289:0:15090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518215.602318:0:15090:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518215.602367:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627492352 00000100:00100000:3.0:1789518215.602377:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627492352 00000100:00100000:3.0:1789518215.602408:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789518215.602416:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed7c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+12:15090:x1876445627492352:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518215.602424:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518215.602436:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc6b17600/0x631fd8698c781d8f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c781d88 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518215.602456:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc6b17600/0x631fd8698c781d8f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c781d88 expref: 13 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518215.602466:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc6b17600/0x631fd8698c781d8f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c781d88 expref: 13 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518215.602474:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17600, rc 0) 00000100:00100000:3.0:1789518215.602559:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed7c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+13:15090:x1876445627492352:12345-0@lo:101:mount.lustre.0 Request processed in 143us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518215.602565:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789518215.602646:0:15090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15090:1876445627492352:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789518215.602661:0:15090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd800/0x631fd8698c781d88 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781d8f expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518215.602672:0:15090:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd800/0x631fd8698c781d88 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c781d8f expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518215.602690:0:15090:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789518215.602707:0:15090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd800/0x631fd8698c781d88 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781d8f expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518215.602712:0:15090:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd800/0x631fd8698c781d88 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781d8f expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518215.602726:0:15090:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789518215.602729:0:15090:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789518215.602732:0:15090:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789518215.602734:0:15090:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789518215.602748:0:15090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffd0696e00/0x631fd8698c781d96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518215.602754:0:15090:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffd0696e00/0x631fd8698c781d96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518215.602762:0:15090:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffd0696e00/0x631fd8698c781d96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518215.602773:0:15090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15090:1876445627492480:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789518215.602802:0:15090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518215.602827:0:15090:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee58e600 going to sleep for 11 seconds 00000100:00100000:1.0:1789518215.602839:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627492480 00000100:00100000:1.0:1789518215.602844:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627492480 00000100:00100000:1.0:1789518215.602878:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789518215.602885:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed7c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+13:15090:x1876445627492480:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518215.602892:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518215.603677:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc2f7e00/0x631fd8698c781d9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c781d96 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518215.603699:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc2f7e00/0x631fd8698c781d9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c781d96 expref: 14 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518215.603709:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc2f7e00/0x631fd8698c781d9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c781d96 expref: 14 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518215.603716:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f7e00, rc 0) 00000100:00100000:1.0:1789518215.603766:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed7c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+14:15090:x1876445627492480:12345-0@lo:101:mount.lustre.0 Request processed in 881us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518215.603773:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789518215.603882:0:15090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15090:1876445627492480:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789518215.603896:0:15090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffd0696e00/0x631fd8698c781d96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781d9d expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518215.603905:0:15090:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffd0696e00/0x631fd8698c781d96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c781d9d expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789518215.604923:0:15090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789518215.606197:0:15090:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789518215.606463:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789518215.606508:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789518215.606543:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789518215.606601:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789518215.606682:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789518215.606718:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789518215.606780:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789518215.606787:0:15090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789518215.606857:0:15090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15090:1876445627492608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789518215.606910:0:15090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518215.606948:0:15090:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee58e300 going to sleep for 11 seconds 00000100:00100000:0.0:1789518215.606953:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627492608 00000100:00100000:0.0:1789518215.606961:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627492608 00000100:00100000:0.0:1789518215.607009:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789518215.607018:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed7c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+14:15090:x1876445627492608:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789518215.607503:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed7c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+14:15090:x1876445627492608:12345-0@lo:501:mount.lustre.0 Request processed in 486us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518215.607515:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789518215.607541:0:15090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15090:1876445627492608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789518215.607572:0:15090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15090:1876445627492736:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789518215.607644:0:15090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518215.607674:0:15090:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee58e300 going to sleep for 11 seconds 00000100:00100000:1.0:1789518215.607733:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627492736 00000100:00100000:1.0:1789518215.607738:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627492736 00000100:00100000:1.0:1789518215.607770:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789518215.607777:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed7c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+14:15090:x1876445627492736:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518215.608076:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed7c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+14:15090:x1876445627492736:12345-0@lo:503:mount.lustre.0 Request processed in 298us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518215.608108:0:15090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15090:1876445627492736:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518215.608175:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000040:00080000:0.0:1789518215.609098:0:15090:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789518215.609228:0:15090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15090:1876445627492864:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789518215.609274:0:15090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518215.609314:0:15090:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518215.609436:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627492864 00000100:00100000:1.0:1789518215.609442:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627492864 00000100:00100000:1.0:1789518215.609477:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789518215.609485:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff72f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+14:15090:x1876445627492864:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518215.609700:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff72f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+14:15090:x1876445627492864:12345-0@lo:502:mount.lustre.0 Request processed in 216us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518215.609708:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789518215.609805:0:15090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15090:1876445627492864:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789518215.610025:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1789518215.610070:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1789518215.610121:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1789518215.610179:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1789518215.610214:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1789518215.610255:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1789518215.610297:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1789518215.610329:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1789518215.610359:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1789518215.610421:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1789518215.610443:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1789518215.610480:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1789518215.610507:0:15090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15090:1876445627492992:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789518215.610544:0:15090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518215.610578:0:15090:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518215.610887:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627492992 00000100:00100000:1.0:1789518215.610892:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627492992 00000100:00100000:1.0:1789518215.610935:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789518215.610943:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff72f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+14:15090:x1876445627492992:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518215.611101:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff72f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+14:15090:x1876445627492992:12345-0@lo:502:mount.lustre.0 Request processed in 157us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518215.611108:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789518215.611413:0:15090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15090:1876445627492992:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789518215.611483:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1789518215.611556:0:15090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1789518215.612546:0:15104:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789518215.612559:0:15104:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1789518215.612565:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518215.612567:0:15104:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789518215.612574:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789518215.612588:0:15104:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff99ffffa53380) 00000020:00000080:0.0:1789518215.612607:0:15104:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789518215.612652:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789518215.613508:0:15104:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ffedb71000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1789518215.613518:0:15104:0:(osd_handler.c:1614:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789518215.613526:0:15104:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x631fd8698c781dab 00010000:00010000:0.0:1789518215.618077:0:15104:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1789518215.618413:0:15104:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1789518215.619697:0:15104:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1789518215.621268:0:15104:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789518215.621279:0:15104:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518215.621284:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518215.621286:0:15104:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789518215.621289:0:15104:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789518215.621292:0:15104:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1789518215.621293:0:15104:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789518215.621294:0:15104:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789518215.621296:0:15104:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789518215.621298:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518215.621299:0:15104:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789518215.621302:0:15104:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789518215.621304:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518215.621305:0:15104:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789518215.621314:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789518215.621316:0:15104:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789518215.621318:0:15104:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518215.621320:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518215.621321:0:15104:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789518215.621323:0:15104:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789518215.621325:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518215.621327:0:15104:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789518215.621329:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789518215.621373:0:15104:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518215.621375:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518215.621377:0:15104:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789518215.621380:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1789518215.621604:0:15090:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1789518215.621659:0:15090:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789518215.621678:0:15090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffd0696e00/0x631fd8698c781d96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781d9d expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518215.621690:0:15090:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffd0696e00/0x631fd8698c781d96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781d9d expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518215.621698:0:15090:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ffedb71000 from 1 10000000:01000000:0.0:1789518215.621701:0:15090:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789518215.621733:0:15090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bce00/0x631fd8698c781db2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518215.621740:0:15090:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffed5bce00/0x631fd8698c781db2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518215.621750:0:15090:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffed5bce00/0x631fd8698c781db2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518215.621779:0:15090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15090:1876445627493120:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789518215.621838:0:15090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518215.621872:0:15090:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789518215.621972:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627493120 00000100:00100000:1.0:1789518215.621979:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627493120 00000100:00100000:1.0:1789518215.622022:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789518215.622031:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff72c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+14:15090:x1876445627493120:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518215.622042:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518215.622055:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc2f6a00/0x631fd8698c781db9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c781db2 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518215.622074:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc2f6a00/0x631fd8698c781db9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c781db2 expref: 15 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518215.622085:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc2f6a00/0x631fd8698c781db9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c781db2 expref: 15 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518215.622092:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f6a00, rc 0) 00000100:00100000:1.0:1789518215.622136:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff72c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+15:15090:x1876445627493120:12345-0@lo:101:mount.lustre.0 Request processed in 106us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518215.622142:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789518215.622247:0:15090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15090:1876445627493120:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789518215.622260:0:15090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffed5bce00/0x631fd8698c781db2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781db9 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518215.622269:0:15090:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bce00/0x631fd8698c781db2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c781db9 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789518215.623477:0:15090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1789518215.624057:0:15090:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789518215.625791:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1789518215.625856:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1789518215.625924:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1789518215.625932:0:15090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1789518215.626013:0:15090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15090:1876445627493248:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789518215.626070:0:15090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518215.627071:0:15090:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789518215.627386:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627493248 00000100:00100000:2.0:1789518215.627393:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627493248 00000100:00100000:2.0:1789518215.627434:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789518215.627443:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff72d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+15:15090:x1876445627493248:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789518215.627942:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff72d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+15:15090:x1876445627493248:12345-0@lo:501:mount.lustre.0 Request processed in 496us (1868us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518215.627942:0:15090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15090:1876445627493248:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789518215.627956:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789518215.627995:0:15090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15090:1876445627493376:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789518215.628048:0:15090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518215.628084:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627493376 00000100:00100000:0.0:1789518215.628084:0:15090:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789518215.628090:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627493376 00000100:00100000:1.0:1789518215.628112:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789518215.628119:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff72cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+15:15090:x1876445627493376:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518215.628251:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff72cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+15:15090:x1876445627493376:12345-0@lo:503:mount.lustre.0 Request processed in 132us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518215.628257:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789518215.628304:0:15090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15090:1876445627493376:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789518215.628850:0:15090:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789518215.628912:0:15090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15090:1876445627493504:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789518215.628951:0:15090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518215.628979:0:15090:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789518215.629025:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627493504 00000100:00100000:2.0:1789518215.629030:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627493504 00000100:00100000:2.0:1789518215.629069:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789518215.629077:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff72c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+15:15090:x1876445627493504:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789518215.630183:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff72c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+15:15090:x1876445627493504:12345-0@lo:502:mount.lustre.0 Request processed in 1103us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518215.630192:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789518215.630832:0:15090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15090:1876445627493504:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789518215.631117:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789518215.631170:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1789518215.631220:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1789518215.631260:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1789518215.631297:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1789518215.631347:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1789518215.631386:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1789518215.631437:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1789518215.631468:0:15090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15090:1876445627493632:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789518215.631516:0:15090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518215.631558:0:15090:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789518215.631673:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627493632 00000100:00100000:3.0:1789518215.631680:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627493632 00000100:00100000:3.0:1789518215.631717:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789518215.631726:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff72d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+15:15090:x1876445627493632:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518215.631955:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff72d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+15:15090:x1876445627493632:12345-0@lo:502:mount.lustre.0 Request processed in 230us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518215.631962:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789518215.632008:0:15090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15090:1876445627493632:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789518215.632088:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1789518215.632098:0:15090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1789518215.633056:0:15108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518215.633065:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518215.633067:0:15108:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789518215.633072:0:15108:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ffedb71000 00000020:00000080:0.0:1789518215.633074:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789518215.633081:0:15108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518215.633083:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518215.633084:0:15108:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789518215.633086:0:15108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518215.633089:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518215.633090:0:15108:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789518215.633093:0:15108:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ffedb71000 00000020:00000080:0.0:1789518215.633112:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789518215.633162:0:15108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518215.633165:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518215.633167:0:15108:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789518215.633170:0:15108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518215.633173:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518215.633175:0:15108:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789518215.633179:0:15108:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99ffedb71000 00000020:00000080:0.0:1789518215.633181:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789518215.633217:0:15108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518215.633221:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518215.633222:0:15108:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789518215.633226:0:15108:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1789518215.633292:0:15090:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1789518215.633323:0:15090:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789518215.633345:0:15090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bce00/0x631fd8698c781db2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781db9 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518215.633362:0:15090:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffed5bce00/0x631fd8698c781db2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781db9 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518215.633404:0:15090:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789518215.633407:0:15090:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99ffedb71000 10000000:01000000:2.0:1789518215.633411:0:15090:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99ffedb71000 10000000:01000000:2.0:1789518215.633416:0:15090:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789518215.633421:0:15090:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99ffedb71000 from 1 10000000:01000000:2.0:1789518215.633425:0:15090:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789518215.633454:0:15090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffd0697e00/0x631fd8698c781dc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518215.633462:0:15090:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffd0697e00/0x631fd8698c781dc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518215.633472:0:15090:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffd0697e00/0x631fd8698c781dc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518215.633490:0:15090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a79c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15090:1876445627493760:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789518215.633551:0:15090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518215.633590:0:15090:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee58ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518215.633652:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627493760 00000100:00100000:0.0:1789518215.633659:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627493760 00000100:00100000:0.0:1789518215.633701:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789518215.633710:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff72ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+15:15090:x1876445627493760:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789518215.633722:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518215.633734:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffed5bdc00/0x631fd8698c781dc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c781dc0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518215.633757:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bdc00/0x631fd8698c781dc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c781dc0 expref: 16 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518215.633898:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffed5bdc00/0x631fd8698c781dc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c781dc0 expref: 16 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518215.633908:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bdc00, rc 0) 00000100:00100000:0.0:1789518215.634004:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff72ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+16:15090:x1876445627493760:12345-0@lo:101:mount.lustre.0 Request processed in 295us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518215.634012:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789518215.634079:0:15090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a79c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15090:1876445627493760:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518215.634095:0:15090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffd0697e00/0x631fd8698c781dc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781dc7 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518215.634114:0:15090:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffd0697e00/0x631fd8698c781dc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c781dc7 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789518215.635004:0:15090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1789518215.635525:0:15090:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789518215.639430:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789518215.639498:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789518215.639538:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789518215.642901:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789518215.643017:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789518215.643112:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789518215.643178:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789518215.643252:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789518215.643342:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789518215.643394:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789518215.643447:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789518215.643518:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789518215.643564:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789518215.643653:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789518215.643716:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789518215.643760:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789518215.643807:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789518215.643897:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789518215.643945:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789518215.643980:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789518215.644032:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789518215.644070:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789518215.644109:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789518215.644164:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789518215.644214:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1789518215.644262:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1789518215.644336:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1789518215.644371:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1789518215.644478:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1789518215.644489:0:15090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1789518215.644581:0:15090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15090:1876445627493888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518215.644672:0:15090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518215.644714:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627493888 00000100:00100000:3.0:1789518215.644717:0:15090:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbed80 going to sleep for 11 seconds 00000100:00100000:2.0:1789518215.644722:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627493888 00000100:00100000:2.0:1789518215.644771:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789518215.644781:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+16:15090:x1876445627493888:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789518215.644995:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+16:15090:x1876445627493888:12345-0@lo:501:mount.lustre.0 Request processed in 215us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518215.645021:0:15090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15090:1876445627493888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518215.645049:0:15090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15090:1876445627494016:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789518215.645083:0:15090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518215.645095:0:15090:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbed80 going to sleep for 11 seconds 00000100:00100000:2.0:1789518215.645247:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789518215.645272:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627494016 00000100:00100000:2.0:1789518215.645276:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627494016 00000100:00100000:2.0:1789518215.645298:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789518215.645305:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+16:15090:x1876445627494016:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789518215.645431:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+16:15090:x1876445627494016:12345-0@lo:503:mount.lustre.0 Request processed in 126us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518215.645439:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789518215.645458:0:15090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15090:1876445627494016:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789518215.646336:0:15090:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789518215.646386:0:15090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15090:1876445627494144:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518215.646431:0:15090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518215.646462:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627494144 00000100:00100000:3.0:1789518215.646467:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627494144 00000100:00100000:3.0:1789518215.646503:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789518215.646511:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+16:15090:x1876445627494144:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518215.646896:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+16:15090:x1876445627494144:12345-0@lo:502:mount.lustre.0 Request processed in 385us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518215.646904:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789518215.646974:0:15090:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbed80 going to sleep for 11 seconds 00000100:00100000:3.0:1789518215.646995:0:15090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15090:1876445627494144:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789518215.647396:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789518215.647464:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1789518215.647500:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1789518215.647549:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1789518215.647594:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1789518215.647693:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1789518215.647728:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1789518215.647772:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1789518215.647843:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789518215.647897:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1789518215.647950:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1789518215.648037:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1789518215.648075:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1789518215.648109:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1789518215.648143:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1789518215.648187:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1789518215.648230:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1789518215.648291:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1789518215.648339:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1789518215.648385:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1789518215.648451:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1789518215.648499:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1789518215.648542:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1789518215.648650:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1789518215.648690:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1789518215.648724:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1789518215.648799:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1789518215.648846:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1789518215.648895:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1789518215.648958:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1789518215.649002:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1789518215.649041:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1789518215.649082:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1789518215.649154:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1789518215.649205:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1789518215.649273:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1789518215.649319:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1789518215.649359:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1789518215.649438:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1789518215.649499:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1789518215.649540:0:15090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15090:1876445627494272:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518215.649646:0:15090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518215.649683:0:15090:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbed80 going to sleep for 11 seconds 00000100:00100000:2.0:1789518215.650069:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627494272 00000100:00100000:2.0:1789518215.650077:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627494272 00000100:00100000:2.0:1789518215.650154:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789518215.650166:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+16:15090:x1876445627494272:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789518215.650404:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+16:15090:x1876445627494272:12345-0@lo:502:mount.lustre.0 Request processed in 241us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518215.650413:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789518215.650437:0:15090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15090:1876445627494272:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789518215.650527:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1789518215.650542:0:15090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1789518215.651724:0:15113:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789518215.651738:0:15113:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff99ffc64a19c0) 00000020:00000080:3.0:1789518215.651757:0:15113:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1789518215.651840:0:15113:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ffedb71000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789518215.651843:0:15113:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ffedb71000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789518215.651845:0:15113:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffedb71000 3 00010000:00080000:3.0:1789518215.651869:0:15113:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99fec1aaa000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.151@tcp at head 00010000:00010000:3.0:1789518215.653521:0:15113:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1789518215.653750:0:15113:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789518215.653780:0:15113:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789518215.653790:0:15113:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x631fd8698c781dd5 00000100:00080000:3.0:1789518215.653799:0:15113:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789518215.653809:0:15113:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99fec1aaa000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1789518215.653840:0:15113:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fff4b1f480 x1876445627494400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789518215.653865:0:15113:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789518215.653907:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3279:1876445627494400:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789518215.653965:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789518215.654080:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789518215.654086:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789518215.654089:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789518215.654092:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789518215.654143:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789518215.654152:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627494528:0@lo:400:kworker.0 00000100:00100000:0.0:1789518215.654183:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518215.654225:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627494400 00000100:00100000:0.0:1789518215.654231:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627494400 00000100:00100000:3.0:1789518215.654240:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627494528 00000100:00100000:3.0:1789518215.654252:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627494528 00000100:00100000:0.0:1789518215.654262:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789518215.654270:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3279:x1876445627494400:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789518215.654282:0:14410:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789518215.654290:0:14410:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00080000:0.0:1789518215.654293:0:14409:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 269 last 0 00000020:00000080:0.0:1789518215.654322:0:14409:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x631fd8698c781ddc 00000004:00100000:0.0:1789518215.654334:0:14409:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789518215.654359:0:14409:0:(import.c:65:import_set_state_nolock()) ffff99fffd282000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789518215.654403:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876445627494400:12345-0@lo:38:llog_process_th.0 Request processed in 133us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518215.654410:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789518215.654426:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789518215.654433:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627494528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518215.654464:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627494528:12345-0@lo:400:kworker.0 Request processed in 32us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518215.654470:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789518215.654508:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99fec1b9ed80 x1876445627494528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518215.654533:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627494528:0@lo:400:kworker.0 00010000:00080000:0.0:1789518215.654569:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99fff4b1f480 x1876445627494400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789518225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518215.654578:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789518215.654584:0:3279:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1789518215.654590:0:3279:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789518215.654595:0:3279:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789518215.654597:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99fec1aaa000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789518215.654603:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3279:1876445627494400:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1789518215.655146:0:15113:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1789518215.655503:0:15090:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1789518215.655528:0:15090:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789518215.655554:0:15090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffd0697e00/0x631fd8698c781dc0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781dc7 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518215.655565:0:15090:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffd0697e00/0x631fd8698c781dc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781dc7 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789518215.655644:0:15090:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789518215.655646:0:15090:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789518215.655647:0:15090:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789518215.655649:0:15090:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789518215.655651:0:15090:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789518215.655659:0:15090:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789518215.655661:0:15090:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789518215.655662:0:15090:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789518215.655664:0:15090:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789518215.655667:0:15090:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1789518215.655669:0:15090:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789518215.655670:0:15090:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789518215.655671:0:15090:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789518215.655672:0:15090:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789518215.655674:0:15090:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789518215.655675:0:15090:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789518215.655676:0:15090:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789518215.655677:0:15090:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789518215.655678:0:15090:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789518215.655696:0:15090:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789518215.655711:0:15090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15090:1876445627494656:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789518215.655760:0:15090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518215.655806:0:15090:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd80a0180 going to sleep for 11 seconds 00000100:00100000:0.0:1789518215.655818:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627494656 00000100:00100000:0.0:1789518215.655825:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627494656 00000100:00100000:0.0:1789518215.655873:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789518215.655879:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+16:15090:x1876445627494656:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789518215.655896:0:14404:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789518215.655908:0:14404:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789518215.677647:0:14404:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789518215.677730:0:14404:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789518215.677971:0:14425:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789518215.677976:0:14425:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789518215.677995:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ffed5bd600/0x631fd8698c781de3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518215.678012:0:14425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffc6b17000/0x631fd8698c781d50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c781d49 expref: 16 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518215.678019:0:14425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ffed5bd600/0x631fd8698c781de3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518215.678054:0:14425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffc6b17000/0x631fd8698c781d50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c781d49 expref: 16 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518215.678080:0:14425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ffc6b17000/0x631fd8698c781d50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c781d49 expref: 16 pid: 14405 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518215.678094:0:14425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14425:1876445627494784:0@lo:104: 00000100:00100000:0.0:1789518215.678154:0:14425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518215.678303:0:14425:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc9184000 going to sleep for 11 seconds 00000100:00100000:3.0:1789518215.678360:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627494784 00000100:00100000:3.0:1789518215.678366:0:14393:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627494784 00000100:00100000:3.0:1789518215.678412:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789518215.678421:0:14393:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+3:14425:x1876445627494784:12345-0@lo:104: 00010000:00010000:3.0:1789518215.678433:0:14393:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7c00/0x631fd8698c781d49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c781d50 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518215.678491:0:14393:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789518215.678498:0:14393:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+3:14425:x1876445627494784:12345-0@lo:104: Request processed in 78us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518215.678504:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789518215.678537:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518215.678543:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7c00/0x631fd8698c781d49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c781d50 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518215.678550:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7c00 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:3.0:1789518215.678553:0:14399:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7c00/0x631fd8698c781d49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c781d50 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518215.678560:0:14399:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7c00/0x631fd8698c781d49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c781d50 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518215.678566:0:14399:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7c00/0x631fd8698c781d49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c781d50 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518215.678571:0:14399:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1789518215.678985:0:14425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14425:1876445627494784:0@lo:104: 00010000:00010000:0.0:1789518215.679003:0:14425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ffed5bd600/0x631fd8698c781de3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518215.679067:0:14399:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7c00/0x631fd8698c781d49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c781d50 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518215.679075:0:14399:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518215.679112:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7c00/0x631fd8698c781d49 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c781d50 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518215.679121:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7c00/0x631fd8698c781d49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c781d50 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518215.679183:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a262dbd-f283-43e3-b7fd-ac44d37658cb:3282:1876445627494912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518215.679214:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518215.679300:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627494912 00000100:00100000:2.0:1789518215.679305:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627494912 00010000:00010000:3.0:1789518215.679325:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518215.679328:0:14395:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffc6b17000/0x631fd8698c781d50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c781d49 expref: 17 pid: 14405 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518215.679329:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518215.679332:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518215.679366:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789518215.679373:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+17:3282:x1876445627494912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789518215.679383:0:14395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518215.679388:0:14395:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffc6b17000/0x631fd8698c781d50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c781d49 expref: 17 pid: 14405 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518215.679400:0:14395:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffc6b17000/0x631fd8698c781d50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c781d49 expref: 17 pid: 14405 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518215.679413:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b17000/0x631fd8698c781d50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c781d49 expref: 17 pid: 14405 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518215.679438:0:14395:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ffed5bd600/0x631fd8698c781de3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518215.679445:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bd600/0x631fd8698c781de3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789518215.679457:0:14395:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001658770s 00010000:00010000:2.0:1789518215.679461:0:14395:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffed5bd600/0x631fd8698c781de3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518215.679468:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffed5bd600/0x631fd8698c781de3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518215.679474:0:14395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ffed5bd600/0x631fd8698c781de3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518215.679480:0:14395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ffed5bd600/0x631fd8698c781de3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518215.679485:0:14395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518215.679489:0:14395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ffed5bd600/0x631fd8698c781de3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518215.679496:0:14395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ffed5bd600/0x631fd8698c781de3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518215.679513:0:14395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ffed5bd600/0x631fd8698c781de3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518215.679522:0:14395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518215.679541:0:14425:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ffed5bd600/0x631fd8698c781de3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518215.679551:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ffed5bd600/0x631fd8698c781de3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518215.679563:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffed5bd600/0x631fd8698c781de3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518215.679572:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+16:3282:x1876445627494912:12345-0@lo:103:ldlm_bl.0 Request processed in 199us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518215.679581:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789518215.679660:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a262dbd-f283-43e3-b7fd-ac44d37658cb:3282:1876445627494912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518215.692550:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+15:15090:x1876445627494656:12345-0@lo:253:mount.lustre.0 Request processed in 36664us (36782us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518215.692563:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789518215.693080:0:15090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15090:1876445627494656:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789518215.693095:0:15090:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789518215.693097:0:15090:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789518215.693099:0:15090:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789518215.693100:0:15090:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789518215.693102:0:15090:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789518215.693103:0:15090:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789518215.693104:0:15090:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789518215.693105:0:15090:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789518215.693107:0:15090:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789518215.693108:0:15090:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789518215.693120:0:15090:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789518215.700314:0:15090:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789518215.701064:0:15090:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789518215.702062:0:15090:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789518215.702778:0:15090:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789518215.703069:0:15090:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789518215.703315:0:15090:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789518215.705427:0:15090:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1789518215.753447:0:15090:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789518215.753455:0:15090:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789518215.753496:0:15090:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789518215.753547:0:15090:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.151@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789518215.753563:0:15090:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789518215.753590:0:15090:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1789518215.922794:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518216.947100:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789518217.331657:0:14407:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789518217.331663:0:14407:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99ffd8b25000 from 7 10000000:01000000:3.0:1789518217.331667:0:14407:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789518217.331703:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17800/0x631fd8698c781dea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518217.331714:0:14407:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17800/0x631fd8698c781dea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518217.331726:0:14407:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17800/0x631fd8698c781dea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518217.331747:0:14407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14407:1876445627495040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789518217.331802:0:14407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518217.331840:0:14407:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd81bf900 going to sleep for 11 seconds 00000100:00100000:3.0:1789518217.331861:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627495040 00000100:00100000:3.0:1789518217.331867:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627495040 00000100:00100000:3.0:1789518217.331968:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789518217.331978:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+15:14407:x1876445627495040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518217.331991:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518217.332004:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c781df1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c781dea expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518217.332026:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c781df1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c781dea expref: 16 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518217.332037:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c781df1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c781dea expref: 16 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518217.332045:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17e00, rc 0) 00000100:00100000:3.0:1789518217.332095:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+16:14407:x1876445627495040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518217.332103:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789518217.332475:0:14407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14407:1876445627495040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518217.332489:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17800/0x631fd8698c781dea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781df1 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518217.332499:0:14407:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17800/0x631fd8698c781dea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c781df1 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518217.332561:0:14407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14407:1876445627495168:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789518217.332596:0:14407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518217.332657:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627495168 00000100:00100000:2.0:1789518217.332663:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627495168 00000100:00100000:3.0:1789518217.332668:0:14407:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd81bf900 going to sleep for 11 seconds 00000100:00100000:2.0:1789518217.332823:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789518217.332833:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+16:14407:x1876445627495168:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789518217.332848:0:14404:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789518217.332864:0:14404:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789518217.332868:0:14404:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789518217.332943:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+16:14407:x1876445627495168:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518217.332950:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789518217.332962:0:14407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14407:1876445627495168:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789518217.333014:0:14407:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789518217.333021:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17800/0x631fd8698c781dea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781df1 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518217.333029:0:14407:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17800/0x631fd8698c781dea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781df1 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518217.971505:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518218.738693:0:3279:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789518208/real 1789518208] req@ffff99fff4b1ea00 x1876445627488640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789518218 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518218.738722:0:3279:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99fff4b1ea00 x1876445627488640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789518218 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518218.738733:0:3279:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789518208/real 1789518208] req@ffff99fec1b9e300 x1876445627488512/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789518218 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518218.738755:0:3279:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99fec1b9e300 x1876445627488512/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789518218 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789518218.738774:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffd1033000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789518218.738795:0:3279:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789518218.738799:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627488640:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789518218.738804:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99fff7b5e800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789518218.738810:0:3279:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789518218.738813:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627488512:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1789518218.739020:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a262dbd-f283-43e3-b7fd-ac44d37658cb:3283:1876445627495296:0@lo:400:kworker.0 00000100:00100000:0.0:1789518218.739078:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789518218.739162:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789518218.739167:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789518218.739170:0:36:0:(import.c:65:import_set_state_nolock()) ffff99fff7b5e800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789518218.739176:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 262 00000100:00080000:1.0:1789518218.739180:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789518218.739190:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99fff7b5e800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1789518218.739215:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fec2976d80 x1876445627495424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789518218.739238:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789518218.739242:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789518218.739244:0:36:0:(import.c:65:import_set_state_nolock()) ffff99ffd1033000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789518218.739249:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 262 00000100:00080000:1.0:1789518218.739253:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789518218.739259:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99ffd1033000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1789518218.739297:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fec2974700 x1876445627495552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789518218.739373:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627495680:0@lo:400:kworker.0 00000100:00100000:1.0:1789518218.739519:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518218.739552:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789518218.739561:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627495808:0@lo:400:kworker.0 00000100:00100000:1.0:1789518218.739588:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518218.739670:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627495680 00000100:00100000:1.0:1789518218.739677:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627495680 00000100:00100000:1.0:1789518218.739724:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627495808 00000100:00100000:1.0:1789518218.739728:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627495808 00000100:00100000:1.0:1789518218.739771:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789518218.739782:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627495680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518218.739827:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627495680:12345-0@lo:400:kworker.0 Request processed in 48us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518218.739834:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789518218.739910:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789518218.739918:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627495808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518218.739950:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627495808:12345-0@lo:400:kworker.0 Request processed in 33us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518218.739956:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789518218.739980:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627495424:0@lo:8:kworker.0 00000100:00100000:1.0:1789518218.740007:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518218.740031:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627495552:0@lo:8:kworker.0 00000100:00100000:1.0:1789518218.740055:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789518218.740091:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99fec2975880 x1876445627495808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518218.740108:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627495808:0@lo:400:kworker.0 00010000:00080000:1.0:1789518218.740119:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99fec2977100 x1876445627495680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518218.740126:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627495680:0@lo:400:kworker.0 00000100:00100000:1.0:1789518218.740157:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627495296 00000100:00100000:1.0:1789518218.740161:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627495296 00000100:00100000:1.0:1789518218.740184:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789518218.740189:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+16:3283:x1876445627495296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518218.740372:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+16:3283:x1876445627495296:12345-0@lo:400:kworker.0 Request processed in 182us (1294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518218.740378:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789518218.740446:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a262dbd-f283-43e3-b7fd-ac44d37658cb:3283:1876445627495296:0@lo:400:kworker.0 00000100:00100000:1.0:1789518218.740667:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627495424 00000100:00100000:1.0:1789518218.740672:0:15091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627495424 00000100:00100000:1.0:1789518218.740689:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627495552 00000100:00100000:1.0:1789518218.740692:0:15091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627495552 00000100:00100000:1.0:1789518218.740703:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789518218.740707:0:15091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3279:x1876445627495424:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789518218.740729:0:15091:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 272 last 0 00000020:00000080:1.0:1789518218.740758:0:15091:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x631fd8698c781df8 00002000:00100000:1.0:1789518218.740770:0:15091:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99ffedb78800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789518218.740774:0:15091:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1789518218.740777:0:15091:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:3.0:1789518218.740935:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00080000:1.0:1789518218.741107:0:15091:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789518218.741130:0:15091:0:(import.c:65:import_set_state_nolock()) ffff99ffedb7f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789518218.741191:0:15091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3279:x1876445627495424:12345-0@lo:8:kworker.0 Request processed in 482us (1183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518218.741199:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789518218.741213:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789518218.741217:0:15091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3279:x1876445627495552:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789518218.741228:0:15091:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789518218.741251:0:15091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3279:x1876445627495552:12345-0@lo:8:kworker.0 Request processed in 33us (1196us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789518218.741257:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789518218.741296:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99fec2976d80 x1876445627495424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789518233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518218.741305:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789518218.741311:0:3279:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789518218.741318:0:3279:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789518218.741323:0:3279:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789518218.741325:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99fff7b5e800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789518218.741427:0:3279:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789518218.741433:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627495424:0@lo:8:kworker.0 00000004:00080000:3.0:1789518218.741440:0:14431:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00080000:1.0:1789518218.741448:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffd1033000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789518218.741463:0:3279:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789518218.741466:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627495552:0@lo:8:kworker.0 00000004:00080000:2.0:1789518218.741654:0:14432:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:2.0:1789518218.741676:0:14432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14432:1876445627496064:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789518218.741683:0:14431:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 272738067678ns, next at 0ns, rc = 0 00000100:00100000:2.0:1789518218.741712:0:14432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518218.741731:0:14432:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0f659c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518218.741751:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627496064 00000100:00100000:2.0:1789518218.741761:0:15093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627496064 00000100:00100000:2.0:1789518218.741795:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789518218.741800:0:15093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14432:x1876445627496064:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789518218.743234:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627495936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518218.743345:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789518218.746391:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518218.746423:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627495936 00000100:00100000:2.0:1789518218.746431:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627495936 00000100:00100000:2.0:1789518218.746469:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789518218.746477:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2974700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1876445627495936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789518218.746506:0:15095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789518218.746576:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2974700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1876445627495936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (3231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518218.746582:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789518218.747281:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99fff7a7bb80 x1876445627495936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518218.747303:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627495936:0@lo:13:osp-pre-0-0.0 00002000:00080000:2.0:1789518218.750984:0:15093:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1789518218.750995:0:15093:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1789518218.751000:0:15093:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:2.0:1789518218.757858:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518218.757872:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c781dff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.757888:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=272s v=(0 0) 00010000:00010000:2.0:1789518218.757893:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518218.757900:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c781dff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.757931:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c781dff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.757942:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c781dff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.757950:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c781dff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.757970:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518218.757983:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518218.757988:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c781dff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.757997:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518218.758001:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c781dff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.758010:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c781dff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.758026:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c781dff lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.758034:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c781dff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.758060:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518218.758062:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518218.758064:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518218.758740:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518218.758748:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000949cb8b0/0x631fd8698c781e06 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.758758:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=272s v=(0 0) 00010000:00010000:2.0:1789518218.758762:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518218.758768:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000949cb8b0/0x631fd8698c781e06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.758779:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000949cb8b0/0x631fd8698c781e06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.758787:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000949cb8b0/0x631fd8698c781e06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.758795:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000949cb8b0/0x631fd8698c781e06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.758812:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518218.758821:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518218.758830:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000949cb8b0/0x631fd8698c781e06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518218.758846:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697a00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518218.758850:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000949cb8b0/0x631fd8698c781e06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518218.758859:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000949cb8b0/0x631fd8698c781e06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518218.758874:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000949cb8b0/0x631fd8698c781e06 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518218.758883:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000949cb8b0/0x631fd8698c781e06 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518218.758902:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518218.758904:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518218.758906:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518218.759350:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518218.759358:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781e0d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.759378:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=272s v=(0 0) 00010000:00010000:2.0:1789518218.759381:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518218.759386:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781e0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.759396:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781e0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.759405:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781e0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.759413:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781e0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.759429:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518218.759438:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518218.759443:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781e0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.759552:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518218.759558:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781e0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.759565:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781e0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.759587:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781e0d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.759604:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781e0d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.759647:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518218.759649:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518218.759651:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518218.760089:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518218.760096:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e3d6691/0x631fd8698c781e14 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.760105:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=272s v=(0 0) 00010000:00010000:2.0:1789518218.760108:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518218.760113:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e3d6691/0x631fd8698c781e14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.760122:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e3d6691/0x631fd8698c781e14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.760129:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e3d6691/0x631fd8698c781e14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.760135:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e3d6691/0x631fd8698c781e14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.760229:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518218.760237:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518218.760241:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e3d6691/0x631fd8698c781e14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.760247:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696c00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518218.760250:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e3d6691/0x631fd8698c781e14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.760257:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e3d6691/0x631fd8698c781e14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.760267:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e3d6691/0x631fd8698c781e14 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.760274:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e3d6691/0x631fd8698c781e14 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.760285:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518218.760287:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518218.760288:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518218.760845:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518218.760852:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ae8672b/0x631fd8698c781e1b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.760861:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=272s v=(0 0) 00010000:00010000:2.0:1789518218.760869:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518218.760874:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ae8672b/0x631fd8698c781e1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.760884:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ae8672b/0x631fd8698c781e1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.760893:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ae8672b/0x631fd8698c781e1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.760900:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ae8672b/0x631fd8698c781e1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.760916:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518218.760924:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518218.760929:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ae8672b/0x631fd8698c781e1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.760935:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518218.760938:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ae8672b/0x631fd8698c781e1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.760945:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ae8672b/0x631fd8698c781e1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.760956:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ae8672b/0x631fd8698c781e1b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.760974:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ae8672b/0x631fd8698c781e1b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.760989:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518218.760991:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518218.760992:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518218.761438:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518218.761445:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c781e22 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.761454:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=272s v=(0 0) 00010000:00010000:2.0:1789518218.761457:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518218.761461:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c781e22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.761471:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c781e22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.761479:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c781e22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.761486:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c781e22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.761501:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518218.761510:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518218.761519:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c781e22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.761525:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518218.761528:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c781e22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.761535:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c781e22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.761545:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c781e22 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.761551:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c781e22 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.761565:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518218.761567:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518218.761568:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518218.768954:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518218.768966:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c781e29 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.768982:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=272s v=(0 0) 00010000:00010000:2.0:1789518218.768987:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518218.768993:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c781e29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.769019:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c781e29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.769030:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c781e29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.769038:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c781e29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.769062:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518218.769228:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518218.769235:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c781e29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518218.769244:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518218.769249:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c781e29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518218.769259:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c781e29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518218.769283:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c781e29 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518218.769291:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c781e29 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518218.769309:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518218.769311:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518218.769312:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518218.772276:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518218.772289:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ae8672b/0x631fd8698c781e30 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.772305:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=272s v=(0 0) 00010000:00010000:2.0:1789518218.772310:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518218.772316:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ae8672b/0x631fd8698c781e30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.772330:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ae8672b/0x631fd8698c781e30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.772340:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ae8672b/0x631fd8698c781e30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.772360:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ae8672b/0x631fd8698c781e30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.772376:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518218.772388:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518218.772393:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ae8672b/0x631fd8698c781e30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.772400:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518218.772406:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ae8672b/0x631fd8698c781e30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.772415:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ae8672b/0x631fd8698c781e30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.772430:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ae8672b/0x631fd8698c781e30 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.772438:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ae8672b/0x631fd8698c781e30 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.772455:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518218.772457:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518218.772459:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518218.772982:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518218.772996:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e3d6691/0x631fd8698c781e37 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.773006:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=272s v=(0 0) 00010000:00010000:2.0:1789518218.773010:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518218.773015:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e3d6691/0x631fd8698c781e37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.773025:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e3d6691/0x631fd8698c781e37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.773034:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e3d6691/0x631fd8698c781e37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.773041:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e3d6691/0x631fd8698c781e37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.773059:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518218.773070:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518218.773075:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e3d6691/0x631fd8698c781e37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.773083:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696c00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518218.773087:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e3d6691/0x631fd8698c781e37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.773095:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e3d6691/0x631fd8698c781e37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.773114:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e3d6691/0x631fd8698c781e37 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.773121:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e3d6691/0x631fd8698c781e37 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.773138:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518218.773139:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518218.773141:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518218.773961:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518218.773969:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781e3e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.773979:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=272s v=(0 0) 00010000:00010000:2.0:1789518218.773982:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518218.773987:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781e3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.773997:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781e3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.774007:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781e3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.774014:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781e3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.774041:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518218.774050:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518218.774054:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781e3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.774062:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518218.774066:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781e3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.774074:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781e3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.774087:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781e3e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.774095:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781e3e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.774109:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518218.774110:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518218.774112:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518218.774896:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518218.774903:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c781e45 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.774914:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=272s v=(0 0) 00010000:00010000:2.0:1789518218.774923:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518218.774929:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c781e45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.774940:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c781e45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.774948:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c781e45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.774956:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c781e45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.774971:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518218.774981:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518218.774985:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c781e45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.774993:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518218.774996:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c781e45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.775004:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c781e45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.775017:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c781e45 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.775036:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c781e45 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.775049:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518218.775051:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518218.775053:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518218.777093:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518218.777103:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c781e4c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.777116:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=272s v=(0 0) 00010000:00010000:2.0:1789518218.777121:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518218.777126:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c781e4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.777139:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c781e4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.777457:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c781e4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.777468:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c781e4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.777487:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518218.777499:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518218.777512:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c781e4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.777521:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518218.777526:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c781e4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.777536:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c781e4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.777554:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c781e4c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.777562:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c781e4c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.777580:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518218.777582:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518218.777583:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518218.778568:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518218.778576:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9d192ce/0x631fd8698c781e53 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.778588:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=272s v=(0 0) 00010000:00010000:2.0:1789518218.778769:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518218.778777:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9d192ce/0x631fd8698c781e53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.778803:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9d192ce/0x631fd8698c781e53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.778813:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9d192ce/0x631fd8698c781e53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.778821:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9d192ce/0x631fd8698c781e53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.778842:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518218.778977:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518218.778986:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9d192ce/0x631fd8698c781e53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.779001:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697c00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518218.779005:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9d192ce/0x631fd8698c781e53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.779014:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9d192ce/0x631fd8698c781e53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.779328:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9d192ce/0x631fd8698c781e53 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.779338:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9d192ce/0x631fd8698c781e53 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.779356:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518218.779358:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518218.779360:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518218.780357:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518218.780368:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c781e5a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.780380:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=272s v=(0 0) 00010000:00010000:2.0:1789518218.780384:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518218.780389:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c781e5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.780401:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c781e5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.780411:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c781e5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.780431:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c781e5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.780567:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1789518218.780793:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1789518218.781219:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518218.781226:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ae8672b/0x631fd8698c781e61 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.781237:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=272s v=(0 0) 00010000:00010000:2.0:1789518218.781240:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518218.781245:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ae8672b/0x631fd8698c781e61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.781256:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ae8672b/0x631fd8698c781e61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.781265:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ae8672b/0x631fd8698c781e61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.781273:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ae8672b/0x631fd8698c781e61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.781327:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789518218.781334:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c781e5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.781342:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518218.781346:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c781e5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.781356:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c781e5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.781378:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c781e5a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.781387:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c781e5a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.781404:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518218.781408:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ae8672b/0x631fd8698c781e61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.781414:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518218.781417:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ae8672b/0x631fd8698c781e61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.781424:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ae8672b/0x631fd8698c781e61 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.781439:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ae8672b/0x631fd8698c781e61 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.781446:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518218.781447:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518218.781449:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518218.781482:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789518218.781487:0:15093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ae8672b/0x631fd8698c781e61 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518218.781933:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518218.781940:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000949cb8b0/0x631fd8698c781e68 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.781949:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=272s v=(0 0) 00010000:00010000:2.0:1789518218.781953:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518218.781957:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000949cb8b0/0x631fd8698c781e68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.781968:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000949cb8b0/0x631fd8698c781e68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.781976:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000949cb8b0/0x631fd8698c781e68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.781984:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000949cb8b0/0x631fd8698c781e68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.782000:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518218.782009:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518218.782013:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000949cb8b0/0x631fd8698c781e68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.782020:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697a00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518218.782024:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000949cb8b0/0x631fd8698c781e68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.782038:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000949cb8b0/0x631fd8698c781e68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.782050:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000949cb8b0/0x631fd8698c781e68 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.782058:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000949cb8b0/0x631fd8698c781e68 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.782071:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518218.782073:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518218.782074:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518218.782254:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518218.783344:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518218.783354:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4169b8e/0x631fd8698c781e6f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.783366:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=272s v=(0 0) 00010000:00010000:2.0:1789518218.783371:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518218.783375:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4169b8e/0x631fd8698c781e6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.783388:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4169b8e/0x631fd8698c781e6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.783397:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4169b8e/0x631fd8698c781e6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.783411:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4169b8e/0x631fd8698c781e6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.783428:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518218.783719:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518218.783726:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4169b8e/0x631fd8698c781e6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.783741:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518218.783744:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4169b8e/0x631fd8698c781e6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.783752:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4169b8e/0x631fd8698c781e6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.783766:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4169b8e/0x631fd8698c781e6f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.783771:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4169b8e/0x631fd8698c781e6f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.783784:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518218.783786:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518218.783787:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518218.783889:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518218.783896:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781e76 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.783905:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=272s v=(0 0) 00010000:00010000:2.0:1789518218.783908:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518218.783912:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781e76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.783922:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781e76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.783930:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781e76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.783937:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781e76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.783958:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789518218.784316:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518218.784319:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518218.784324:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e3d6691/0x631fd8698c781e7d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.784325:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781e76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.784336:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518218.784340:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781e76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.784347:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=272s v=(0 0) 00010000:00010000:0.0:1789518218.784350:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781e76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.784352:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518218.784357:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e3d6691/0x631fd8698c781e7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.784382:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e3d6691/0x631fd8698c781e7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.784382:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781e76 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.784400:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9b56070/0x631fd8698c781e76 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.784404:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e3d6691/0x631fd8698c781e7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.784411:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518218.784414:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e3d6691/0x631fd8698c781e7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.784414:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518218.784417:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518218.784443:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518218.784641:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518218.784647:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e3d6691/0x631fd8698c781e7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.784655:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696c00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518218.784659:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e3d6691/0x631fd8698c781e7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.784669:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e3d6691/0x631fd8698c781e7d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.784682:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e3d6691/0x631fd8698c781e7d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.784689:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e3d6691/0x631fd8698c781e7d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.784716:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518218.784718:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518218.784720:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518218.784862:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518218.784868:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e2fb305/0x631fd8698c781e84 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.784876:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=272s v=(0 0) 00010000:00010000:2.0:1789518218.784879:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518218.784884:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e2fb305/0x631fd8698c781e84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.784893:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e2fb305/0x631fd8698c781e84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.784913:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e2fb305/0x631fd8698c781e84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.784920:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e2fb305/0x631fd8698c781e84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.784937:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518218.784956:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518218.784963:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e2fb305/0x631fd8698c781e84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.784971:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518218.784979:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e2fb305/0x631fd8698c781e84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.784989:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e2fb305/0x631fd8698c781e84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.785002:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e2fb305/0x631fd8698c781e84 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.785010:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e2fb305/0x631fd8698c781e84 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.785028:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518218.785031:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518218.785034:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518218.785307:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518218.785313:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8a4f941/0x631fd8698c781e8b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.785323:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=272s v=(0 0) 00010000:00010000:2.0:1789518218.785326:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518218.785330:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8a4f941/0x631fd8698c781e8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.785340:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8a4f941/0x631fd8698c781e8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.785348:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8a4f941/0x631fd8698c781e8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.785356:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8a4f941/0x631fd8698c781e8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.785382:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518218.785402:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518218.785409:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8a4f941/0x631fd8698c781e8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.785428:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518218.785431:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8a4f941/0x631fd8698c781e8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.785439:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8a4f941/0x631fd8698c781e8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.785468:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8a4f941/0x631fd8698c781e8b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.785476:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8a4f941/0x631fd8698c781e8b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.785495:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518218.785497:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518218.785500:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518218.785932:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518218.785938:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c62e73c/0x631fd8698c781e92 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.785947:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=272s v=(0 0) 00010000:00010000:2.0:1789518218.785952:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518218.785956:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c62e73c/0x631fd8698c781e92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.785967:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c62e73c/0x631fd8698c781e92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.785975:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c62e73c/0x631fd8698c781e92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.785982:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c62e73c/0x631fd8698c781e92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.786046:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789518218.786430:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518218.786436:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9d192ce/0x631fd8698c781e99 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.786446:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=272s v=(0 0) 00010000:00010000:2.0:1789518218.786453:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518218.786458:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9d192ce/0x631fd8698c781e99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.786469:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9d192ce/0x631fd8698c781e99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.786478:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9d192ce/0x631fd8698c781e99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.786487:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9d192ce/0x631fd8698c781e99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.786562:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789518218.786569:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c62e73c/0x631fd8698c781e92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.786577:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518218.786580:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c62e73c/0x631fd8698c781e92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.786590:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c62e73c/0x631fd8698c781e92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.786646:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c62e73c/0x631fd8698c781e92 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.786655:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c62e73c/0x631fd8698c781e92 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.786672:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518218.786676:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9d192ce/0x631fd8698c781e99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.786683:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697c00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518218.786687:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9d192ce/0x631fd8698c781e99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.786695:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9d192ce/0x631fd8698c781e99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.786704:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9d192ce/0x631fd8698c781e99 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.786710:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518218.786712:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518218.786714:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518218.786795:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789518218.786801:0:15093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9d192ce/0x631fd8698c781e99 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518218.787252:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518218.787259:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000399a7ea8/0x631fd8698c781ea0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.787269:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=272s v=(0 0) 00010000:00010000:2.0:1789518218.787273:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518218.787277:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000399a7ea8/0x631fd8698c781ea0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.787288:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000399a7ea8/0x631fd8698c781ea0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.787303:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000399a7ea8/0x631fd8698c781ea0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.787311:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000399a7ea8/0x631fd8698c781ea0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.787393:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518218.787399:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000399a7ea8/0x631fd8698c781ea0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.787418:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29c9a00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518218.787422:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000399a7ea8/0x631fd8698c781ea0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.787430:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000399a7ea8/0x631fd8698c781ea0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.787443:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000399a7ea8/0x631fd8698c781ea0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.787452:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518218.787453:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518218.787456:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518218.787488:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789518218.787494:0:15093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000399a7ea8/0x631fd8698c781ea0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.788433:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518218.788733:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518218.788741:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba41c924/0x631fd8698c781ea7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.788755:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=272s v=(0 0) 00010000:00010000:2.0:1789518218.788760:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518218.788764:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba41c924/0x631fd8698c781ea7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.788776:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba41c924/0x631fd8698c781ea7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.788786:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba41c924/0x631fd8698c781ea7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.788805:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba41c924/0x631fd8698c781ea7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.788822:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518218.789248:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518218.789255:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba41c924/0x631fd8698c781ea7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.789263:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29c9400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518218.789268:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba41c924/0x631fd8698c781ea7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.789277:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba41c924/0x631fd8698c781ea7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.789292:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba41c924/0x631fd8698c781ea7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.789306:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba41c924/0x631fd8698c781ea7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.789325:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518218.789327:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518218.789329:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518218.789819:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518218.789825:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098cacc6a/0x631fd8698c781eae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.789834:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=272s v=(0 0) 00010000:00010000:0.0:1789518218.789838:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518218.789842:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098cacc6a/0x631fd8698c781eae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.789852:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098cacc6a/0x631fd8698c781eae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.789859:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098cacc6a/0x631fd8698c781eae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.789866:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098cacc6a/0x631fd8698c781eae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.789885:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518218.790894:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518218.790903:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098cacc6a/0x631fd8698c781eae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.790919:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bca00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518218.790924:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098cacc6a/0x631fd8698c781eae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.790935:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098cacc6a/0x631fd8698c781eae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.790953:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098cacc6a/0x631fd8698c781eae lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.790962:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098cacc6a/0x631fd8698c781eae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.790981:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518218.790983:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518218.790985:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518218.791511:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518218.791523:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f430e8e/0x631fd8698c781eb5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.791535:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=272s v=(0 0) 00010000:00010000:0.0:1789518218.791539:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518218.791544:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f430e8e/0x631fd8698c781eb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.791557:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f430e8e/0x631fd8698c781eb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.791566:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f430e8e/0x631fd8698c781eb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.791575:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f430e8e/0x631fd8698c781eb5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.791669:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789518218.792133:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518218.792140:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c781ebc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.792268:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=272s v=(0 0) 00010000:00010000:0.0:1789518218.792272:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518218.792278:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c781ebc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.792289:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c781ebc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.792304:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c781ebc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518218.792312:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c781ebc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518218.792573:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789518218.792581:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f430e8e/0x631fd8698c781eb5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518218.792590:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518218.792605:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f430e8e/0x631fd8698c781eb5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518218.792642:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f430e8e/0x631fd8698c781eb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518218.792660:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f430e8e/0x631fd8698c781eb5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518218.792669:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f430e8e/0x631fd8698c781eb5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518218.792697:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518218.792701:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c781ebc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518218.792708:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518218.792712:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c781ebc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518218.792720:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c781ebc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518218.792730:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c781ebc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518218.792737:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518218.792739:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518218.792741:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518218.792793:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789518218.792799:0:15093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c781ebc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518218.792802:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1789518218.793027:0:15093:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:0.0:1789518218.793115:0:15093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14432:x1876445627496064:12345-0@lo:5:osp-pre-0-0.0 Request processed in 51311us (51400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518218.793125:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789518218.793180:0:14432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14432:1876445627496064:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789518218.793199:0:14432:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:2.0:1789518218.793239:0:14432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14432:1876445627496192:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789518218.793283:0:14432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518218.793324:0:14432:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0f659c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518218.793371:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627496192 00000100:00100000:1.0:1789518218.793377:0:15092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627496192 00000100:00100000:1.0:1789518218.793422:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789518218.793432:0:15092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14432:x1876445627496192:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1789518218.793466:0:15092:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1789518218.813374:0:15092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14432:x1876445627496192:12345-0@lo:5:osp-pre-0-0.0 Request processed in 19939us (20086us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789518218.813387:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789518218.813708:0:14432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14432:1876445627496192:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789518218.813725:0:14432:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:1.0:1789518218.995019:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789518219.009385:0:15457:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789518220.020046:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789518220.211124:0:14443:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789518220.211133:0:14443:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518220.211181:0:14443:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1789518220.211187:0:14443:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1789518220.973073:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1789518220.973095:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1789518221.042886:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518222.067801:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789518223.017851:0:15808:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789518223.017854:0:15808:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1789518223.017999:0:15808:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99ffedb7a000 00000020:01000004:1.0:1789518223.018013:0:15808:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789518223.018024:0:15808:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1789518223.018036:0:15808:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff99fff78399c0) 00000020:00000080:1.0:1789518223.018050:0:15808:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789518223.033366:0:15808:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789518223.033811:0:15808:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1789518223.034810:0:15808:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789518223.035050:0:15808:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1789518223.035333:0:15808:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1789518223.035884:0:15808:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 495: rc = 0 00100000:10000000:1.0:1789518223.035984:0:15808:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 495: rc = 0 00100000:10000000:1.0:1789518223.036084:0:15808:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 495: rc = 0 00100000:10000000:1.0:1789518223.036867:0:15808:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 770: rc = 0 00100000:10000000:1.0:1789518223.037120:0:15808:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 770: rc = 0 00100000:10000000:1.0:1789518223.037434:0:15808:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 770: rc = 0 00100000:10000000:1.0:1789518223.037856:0:15808:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 770: rc = 0 00100000:10000000:1.0:1789518223.038114:0:15808:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 770: rc = 0 00100000:10000000:1.0:1789518223.038451:0:15808:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 770: rc = 0 00000020:00000080:1.0:1789518223.039249:0:15808:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1789518223.039259:0:15808:0:(osd_handler.c:1614:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789518223.039268:0:15808:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x631fd8698c781eca 00000020:01000004:1.0:1789518223.039275:0:15808:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1789518223.039292:0:15808:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.151@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789518223.039296:0:15808:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789518223.039301:0:15808:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1789518223.039319:0:15808:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1789518223.039328:0:15808:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.151@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789518223.051379:0:15808:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789518223.051416:0:15808:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.151@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1789518223.051420:0:15808:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789518223.051422:0:15808:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789518223.051423:0:15808:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518223.051424:0:15808:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518223.051426:0:15808:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518223.051427:0:15808:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518223.051428:0:15808:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789518223.051430:0:15808:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518223.051431:0:15808:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789518223.051435:0:15808:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1789518223.051437:0:15808:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789518223.051439:0:15808:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789518223.051440:0:15808:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518223.051441:0:15808:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518223.051442:0:15808:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518223.051444:0:15808:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518223.051445:0:15808:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789518223.051446:0:15808:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518223.051447:0:15808:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789518223.051478:0:15808:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789518223.051497:0:15808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2976d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15808:1876445627496320:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789518223.051630:0:15808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518223.051668:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627496320 00000100:00100000:1.0:1789518223.051673:0:15808:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc67cbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789518223.051676:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627496320 00000100:00100000:2.0:1789518223.051720:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789518223.051728:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+16:15808:x1876445627496320:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789518223.051757:0:14405:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789518223.051760:0:14405:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1789518223.051763:0:14405:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789518223.062919:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+16:15808:x1876445627496320:12345-0@lo:253:mount.lustre.0 Request processed in 11184us (11297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518223.062933:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789518223.063043:0:15808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2976d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15808:1876445627496320:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789518223.063058:0:15808:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789518223.063061:0:15808:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789518223.063062:0:15808:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789518223.063064:0:15808:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518223.063065:0:15808:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518223.063067:0:15808:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518223.063068:0:15808:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518223.063069:0:15808:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789518223.063071:0:15808:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518223.063084:0:15808:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789518223.063102:0:15808:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99ffedb7a000 from lustre-OST0001 10000000:01000000:1.0:1789518223.063143:0:15808:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789518223.063146:0:15808:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789518223.063153:0:15808:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99fff7838000 local copy 00010000:00010000:1.0:1789518223.063163:0:15808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7a00/0x631fd8698c781c70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781c77 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518223.063379:0:15808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2976d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15808:1876445627496448:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518223.063413:0:15808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518223.063491:0:15808:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc67cb840 going to sleep for 11 seconds 00000100:00100000:2.0:1789518223.065268:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627496448 00000100:00100000:2.0:1789518223.065281:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627496448 00000100:00100000:2.0:1789518223.065441:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789518223.065452:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+16:15808:x1876445627496448:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789518223.065734:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+16:15808:x1876445627496448:12345-0@lo:501:mount.lustre.0 Request processed in 283us (2319us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789518223.065741:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789518223.065798:0:15808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2976d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15808:1876445627496448:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789518223.065900:0:15808:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789518223.066066:0:15808:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789518223.066075:0:15808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7a00/0x631fd8698c781c70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781c77 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.066086:0:15808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7a00/0x631fd8698c781c70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781c77 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518223.066392:0:15808:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99ffedb7a000 10000000:01000000:3.0:1789518223.066397:0:15808:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789518223.066403:0:15808:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789518223.066406:0:15808:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789518223.066410:0:15808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789518223.066418:0:15808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789518223.066446:0:15808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16400/0x631fd8698c781ed1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.066455:0:15808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16400/0x631fd8698c781ed1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.066463:0:15808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16400/0x631fd8698c781ed1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518223.066482:0:15808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15808:1876445627496576:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789518223.066521:0:15808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518223.066557:0:15808:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc9184e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789518223.066641:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627496576 00000100:00100000:0.0:1789518223.066648:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627496576 00000100:00100000:0.0:1789518223.066682:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789518223.066691:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+16:15808:x1876445627496576:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789518223.066708:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518223.066721:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffed5bde00/0x631fd8698c781ed8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c781ed1 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.066742:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bde00/0x631fd8698c781ed8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c781ed1 expref: 17 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.066752:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffed5bde00/0x631fd8698c781ed8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c781ed1 expref: 17 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.066761:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bde00, rc 0) 00000100:00100000:0.0:1789518223.066799:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+17:15808:x1876445627496576:12345-0@lo:101:mount.lustre.0 Request processed in 110us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518223.066806:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789518223.067072:0:15808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15808:1876445627496576:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518223.067088:0:15808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16400/0x631fd8698c781ed1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781ed8 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.067725:0:15808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16400/0x631fd8698c781ed1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c781ed8 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789518223.070257:0:15808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789518223.071508:0:15808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789518223.072008:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789518223.072052:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789518223.072083:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789518223.072126:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789518223.072162:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789518223.072193:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789518223.072253:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789518223.072260:0:15808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789518223.072343:0:15808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15808:1876445627496704:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518223.072402:0:15808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518223.072450:0:15808:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc9184c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789518223.072462:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627496704 00000100:00100000:2.0:1789518223.072471:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627496704 00000100:00100000:2.0:1789518223.072518:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789518223.072529:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+17:15808:x1876445627496704:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789518223.072888:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+17:15808:x1876445627496704:12345-0@lo:501:mount.lustre.0 Request processed in 361us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518223.072896:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789518223.073675:0:15808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15808:1876445627496704:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518223.073721:0:15808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15808:1876445627496832:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789518223.073767:0:15808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518223.073795:0:15808:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc9184c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789518223.074007:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627496832 00000100:00100000:1.0:1789518223.074014:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627496832 00000100:00100000:1.0:1789518223.074065:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789518223.074075:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+17:15808:x1876445627496832:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518223.074361:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+17:15808:x1876445627496832:12345-0@lo:503:mount.lustre.0 Request processed in 288us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518223.074368:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789518223.074483:0:15808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15808:1876445627496832:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789518223.075100:0:15808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789518223.075159:0:15808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15808:1876445627496960:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518223.075199:0:15808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518223.075236:0:15808:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc9184c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789518223.075252:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627496960 00000100:00100000:2.0:1789518223.075257:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627496960 00000100:00100000:2.0:1789518223.075281:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789518223.075286:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+17:15808:x1876445627496960:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789518223.075477:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+17:15808:x1876445627496960:12345-0@lo:502:mount.lustre.0 Request processed in 189us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518223.075484:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789518223.075777:0:15808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15808:1876445627496960:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789518223.076075:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789518223.076122:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789518223.076153:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789518223.076198:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789518223.076230:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789518223.076259:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789518223.076305:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789518223.076340:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789518223.076383:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1789518223.076407:0:15808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15808:1876445627497088:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518223.076445:0:15808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518223.076478:0:15808:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc9184c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518223.076718:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627497088 00000100:00100000:0.0:1789518223.076723:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627497088 00000100:00100000:0.0:1789518223.076755:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789518223.076763:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+17:15808:x1876445627497088:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789518223.076930:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+17:15808:x1876445627497088:12345-0@lo:502:mount.lustre.0 Request processed in 166us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518223.076937:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789518223.078843:0:15808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15808:1876445627497088:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789518223.078983:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1789518223.078998:0:15808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1789518223.081886:0:15810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789518223.081896:0:15810:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1789518223.081903:0:15810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518223.081905:0:15810:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789518223.081911:0:15810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789518223.081938:0:15810:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff99fec2aa0000) 00000020:00000080:0.0:1789518223.081961:0:15810:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789518223.081968:0:15810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789518223.082031:0:15810:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ffedb7a000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789518223.082039:0:15810:0:(osd_handler.c:1614:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789518223.082046:0:15810:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x631fd8698c781ee6 00010000:00010000:2.0:1789518223.091151:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518223.092483:0:15810:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1789518223.093105:0:15810:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:0.0:1789518223.095074:0:15810:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1789518223.096468:0:15810:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789518223.096479:0:15810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518223.096486:0:15810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518223.096488:0:15810:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789518223.096491:0:15810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518223.096495:0:15810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518223.096496:0:15810:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789518223.096499:0:15810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789518223.096501:0:15810:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789518223.096503:0:15810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518223.096505:0:15810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518223.096506:0:15810:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789518223.096508:0:15810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518223.096510:0:15810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518223.096512:0:15810:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789518223.096514:0:15810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789518223.096561:0:15810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518223.096564:0:15810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518223.096565:0:15810:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789518223.096568:0:15810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1789518223.099408:0:15808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1789518223.099447:0:15808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789518223.099469:0:15808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16400/0x631fd8698c781ed1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781ed8 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.099481:0:15808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16400/0x631fd8698c781ed1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781ed8 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518223.099491:0:15808:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ffedb7a000 from 1 10000000:01000000:1.0:1789518223.099494:0:15808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789518223.099529:0:15808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7400/0x631fd8698c781eed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.099545:0:15808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7400/0x631fd8698c781eed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.099555:0:15808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7400/0x631fd8698c781eed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518223.099591:0:15808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15808:1876445627497216:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789518223.099673:0:15808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518223.099713:0:15808:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc67cb480 going to sleep for 11 seconds 00000100:00100000:1.0:1789518223.099733:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627497216 00000100:00100000:1.0:1789518223.099739:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627497216 00000100:00100000:1.0:1789518223.099784:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789518223.099793:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+17:15808:x1876445627497216:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518223.100072:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518223.100087:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc2f6600/0x631fd8698c781ef4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c781eed expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.100113:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc2f6600/0x631fd8698c781ef4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c781eed expref: 18 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.100124:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc2f6600/0x631fd8698c781ef4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c781eed expref: 18 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518223.100133:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f6600, rc 0) 00000100:00100000:1.0:1789518223.100222:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+18:15808:x1876445627497216:12345-0@lo:101:mount.lustre.0 Request processed in 429us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518223.100229:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789518223.100322:0:15808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15808:1876445627497216:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518223.100340:0:15808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7400/0x631fd8698c781eed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781ef4 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.100349:0:15808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7400/0x631fd8698c781eed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c781ef4 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789518223.101136:0:15808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789518223.101421:0:15808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789518223.101985:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789518223.104190:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789518223.104282:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789518223.104287:0:15808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789518223.104398:0:15808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15808:1876445627497344:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518223.104459:0:15808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518223.104492:0:15808:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff406e600 going to sleep for 11 seconds 00000100:00100000:1.0:1789518223.105724:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627497344 00000100:00100000:1.0:1789518223.105734:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627497344 00000100:00100000:1.0:1789518223.105793:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789518223.106605:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+18:15808:x1876445627497344:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518223.107378:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+18:15808:x1876445627497344:12345-0@lo:501:mount.lustre.0 Request processed in 1575us (2916us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518223.107386:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789518223.107897:0:15808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15808:1876445627497344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789518223.107949:0:15808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15808:1876445627497472:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789518223.107997:0:15808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518223.108078:0:15808:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0f65d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789518223.108116:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627497472 00000100:00100000:1.0:1789518223.108123:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627497472 00000100:00100000:1.0:1789518223.108206:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789518223.108218:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+18:15808:x1876445627497472:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518223.108387:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+18:15808:x1876445627497472:12345-0@lo:503:mount.lustre.0 Request processed in 172us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518223.108394:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789518223.108457:0:15808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15808:1876445627497472:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789518223.109360:0:15808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789518223.109431:0:15808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15808:1876445627497600:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789518223.109479:0:15808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518223.109525:0:15808:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0f65d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789518223.109783:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627497600 00000100:00100000:3.0:1789518223.109790:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627497600 00000100:00100000:3.0:1789518223.109841:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789518223.109848:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+18:15808:x1876445627497600:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518223.110046:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+18:15808:x1876445627497600:12345-0@lo:502:mount.lustre.0 Request processed in 198us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518223.110054:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789518223.110252:0:15808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15808:1876445627497600:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789518223.110487:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789518223.110538:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789518223.110606:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789518223.110883:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789518223.110923:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789518223.110976:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789518223.111013:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789518223.111049:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1789518223.111082:0:15808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15808:1876445627497728:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789518223.111127:0:15808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518223.111198:0:15808:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0f65d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789518223.111238:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627497728 00000100:00100000:3.0:1789518223.111243:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627497728 00000100:00100000:3.0:1789518223.111317:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789518223.111331:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+18:15808:x1876445627497728:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518223.111493:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+18:15808:x1876445627497728:12345-0@lo:502:mount.lustre.0 Request processed in 162us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518223.111501:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789518223.111594:0:15808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15808:1876445627497728:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789518223.111696:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1789518223.111706:0:15808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1789518223.112471:0:15814:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789518223.112480:0:15814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518223.112483:0:15814:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789518223.112490:0:15814:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ffedb7a000 00000020:00000080:2.0:1789518223.112492:0:15814:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789518223.112498:0:15814:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789518223.112501:0:15814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518223.112502:0:15814:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789518223.112505:0:15814:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789518223.112508:0:15814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518223.112509:0:15814:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789518223.112513:0:15814:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ffedb7a000 00000020:00000080:2.0:1789518223.112515:0:15814:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789518223.112568:0:15814:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789518223.112581:0:15814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518223.112583:0:15814:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789518223.112586:0:15814:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789518223.112598:0:15814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518223.112599:0:15814:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789518223.112604:0:15814:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99ffedb7a000 00000020:00000080:2.0:1789518223.112606:0:15814:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789518223.112660:0:15814:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789518223.112664:0:15814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518223.112665:0:15814:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789518223.112668:0:15814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1789518223.117812:0:15808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1789518223.117849:0:15808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789518223.117872:0:15808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7400/0x631fd8698c781eed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781ef4 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.117882:0:15808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7400/0x631fd8698c781eed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781ef4 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518223.117939:0:15808:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789518223.117942:0:15808:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99ffedb7a000 10000000:01000000:0.0:1789518223.117944:0:15808:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99ffedb7a000 10000000:01000000:0.0:1789518223.117948:0:15808:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789518223.117954:0:15808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99ffedb7a000 from 1 10000000:01000000:0.0:1789518223.117957:0:15808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789518223.117989:0:15808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bcc00/0x631fd8698c781efb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.117998:0:15808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffed5bcc00/0x631fd8698c781efb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.118009:0:15808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffed5bcc00/0x631fd8698c781efb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518223.118031:0:15808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15808:1876445627497856:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789518223.118092:0:15808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518223.118129:0:15808:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc2d43a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789518223.118156:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627497856 00000100:00100000:0.0:1789518223.118163:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627497856 00000100:00100000:0.0:1789518223.118200:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789518223.118208:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+18:15808:x1876445627497856:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789518223.118221:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518223.118232:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffed5bc000/0x631fd8698c781f02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c781efb expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.118255:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bc000/0x631fd8698c781f02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c781efb expref: 19 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.118277:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffed5bc000/0x631fd8698c781f02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c781efb expref: 19 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.118286:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc000, rc 0) 00000100:00100000:0.0:1789518223.118324:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+19:15808:x1876445627497856:12345-0@lo:101:mount.lustre.0 Request processed in 116us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518223.118331:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789518223.118497:0:15808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15808:1876445627497856:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789518223.118508:0:15808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffed5bcc00/0x631fd8698c781efb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781f02 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.118515:0:15808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bcc00/0x631fd8698c781efb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c781f02 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789518223.119376:0:15808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1789518223.119695:0:15808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789518223.120055:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789518223.120097:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789518223.120125:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789518223.120173:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789518223.120208:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789518223.120265:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789518223.120298:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789518223.120328:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789518223.120377:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789518223.120411:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789518223.120445:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789518223.120491:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789518223.120525:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789518223.120559:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789518223.120640:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789518223.120690:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789518223.120718:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789518223.120760:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789518223.120796:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789518223.122997:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789518223.123077:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789518223.123117:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789518223.123159:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789518223.123226:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789518223.123277:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1789518223.123328:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1789518223.123379:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1789518223.123416:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1789518223.123454:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1789518223.123518:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1789518223.123558:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1789518223.123645:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1789518223.123684:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1789518223.123740:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1789518223.123781:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1789518223.124898:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1789518223.124973:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1789518223.125099:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1789518223.125110:0:15808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1789518223.125209:0:15808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15808:1876445627497984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518223.125272:0:15808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518223.125352:0:15808:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff406eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789518223.130947:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627497984 00000100:00100000:1.0:1789518223.130960:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627497984 00000100:00100000:1.0:1789518223.131020:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789518223.131029:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff422b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+19:15808:x1876445627497984:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518223.131319:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff422b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+19:15808:x1876445627497984:12345-0@lo:501:mount.lustre.0 Request processed in 291us (6046us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518223.131328:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789518223.131386:0:15808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15808:1876445627497984:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518223.131431:0:15808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2975880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15808:1876445627498112:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518223.131474:0:15808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518223.131507:0:15808:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789518223.131918:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627498112 00000100:00100000:0.0:1789518223.131923:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627498112 00000100:00100000:0.0:1789518223.131949:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789518223.131957:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff422b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+19:15808:x1876445627498112:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789518223.132104:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff422b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+19:15808:x1876445627498112:12345-0@lo:503:mount.lustre.0 Request processed in 147us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518223.132110:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789518223.132762:0:15808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2975880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15808:1876445627498112:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789518223.133399:0:15808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789518223.133463:0:15808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2975880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15808:1876445627498240:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518223.133512:0:15808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518223.133544:0:15808:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789518223.133657:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627498240 00000100:00100000:3.0:1789518223.133662:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627498240 00000100:00100000:3.0:1789518223.133703:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789518223.133712:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff422b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+19:15808:x1876445627498240:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518223.134138:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff422b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+19:15808:x1876445627498240:12345-0@lo:502:mount.lustre.0 Request processed in 427us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518223.134145:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789518223.135009:0:15808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2975880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15808:1876445627498240:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789518223.135671:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789518223.135736:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789518223.135763:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789518223.135803:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789518223.135839:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789518223.135875:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789518223.135909:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789518223.135938:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789518223.135982:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789518223.136012:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789518223.136040:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789518223.136078:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789518223.136113:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789518223.136142:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789518223.136193:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789518223.136254:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789518223.136292:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789518223.136349:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789518223.136387:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789518223.136423:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789518223.136478:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789518223.136527:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789518223.136589:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789518223.136672:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789518223.136740:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1789518223.136781:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1789518223.136832:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1789518223.136867:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1789518223.136899:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1789518223.136951:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1789518223.136992:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1789518223.137036:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1789518223.137072:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1789518223.137124:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1789518223.137171:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1789518223.137225:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1789518223.137268:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1789518223.137316:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1789518223.137372:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1789518223.137411:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1789518223.137457:0:15808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15808:1876445627498368:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789518223.137529:0:15808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518223.137594:0:15808:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc2d43c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789518223.137666:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627498368 00000100:00100000:1.0:1789518223.137673:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627498368 00000100:00100000:1.0:1789518223.137724:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789518223.137737:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+19:15808:x1876445627498368:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518223.138100:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+19:15808:x1876445627498368:12345-0@lo:502:mount.lustre.0 Request processed in 366us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518223.138110:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789518223.138132:0:15808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15808:1876445627498368:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789518223.138216:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1789518223.138228:0:15808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1789518223.141110:0:15819:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789518223.141125:0:15819:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff99fec2aa4d40) 00000020:00000080:0.0:1789518223.141146:0:15819:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1789518223.141228:0:15819:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ffedb7a000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789518223.141232:0:15819:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ffedb7a000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789518223.141235:0:15819:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffedb7a000 3 00010000:00080000:0.0:1789518223.141264:0:15819:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99fec35a2800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.151@tcp at head 00010000:00010000:0.0:1789518223.146250:0:15819:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1789518223.146393:0:15819:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1789518223.146419:0:15819:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789518223.146427:0:15819:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x631fd8698c781f10 00000100:00080000:0.0:1789518223.146435:0:15819:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789518223.146443:0:15819:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99fec35a2800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1789518223.146472:0:15819:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fec1b9f800 x1876445627498496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789518223.146947:0:15819:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789518223.147814:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3279:1876445627498496:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789518223.147882:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518223.147987:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627498496 00000100:00100000:1.0:1789518223.147993:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627498496 00000100:00100000:1.0:1789518223.148025:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789518223.148032:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3279:x1876445627498496:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789518223.148054:0:14409:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 277 last 0 00000020:00000080:1.0:1789518223.148102:0:14409:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x631fd8698c781f17 00000004:00100000:1.0:1789518223.148116:0:14409:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789518223.148146:0:14409:0:(import.c:65:import_set_state_nolock()) ffff99fec112f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789518223.148192:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876445627498496:12345-0@lo:38:llog_process_th.0 Request processed in 159us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518223.148200:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789518223.148238:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99fec1b9f800 x1876445627498496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789518233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518223.148258:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789518223.148264:0:3279:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1789518223.148271:0:3279:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789518223.148275:0:3279:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789518223.148277:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99fec35a2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789518223.148283:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3279:1876445627498496:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1789518223.148393:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789518223.148398:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789518223.148400:0:8:0:(import.c:65:import_set_state_nolock()) ffff99ffd1033000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789518223.148405:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 272 00000100:00080000:2.0:1789518223.148408:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789518223.148414:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99ffd1033000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1789518223.148430:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fff7a78000 x1876445627498752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789518223.148468:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518223.148477:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627498624:0@lo:400:kworker.0 00000100:00100000:2.0:1789518223.148509:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518223.148538:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627498624 00000100:00100000:2.0:1789518223.148542:0:15091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627498624 00000100:00100000:2.0:1789518223.148596:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789518223.148604:0:15091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627498624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518223.148664:0:15091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627498624:12345-0@lo:400:kworker.0 Request processed in 62us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518223.148672:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789518223.148688:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518223.148704:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789518223.148726:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627498624:0@lo:400:kworker.0 00000100:00100000:1.0:1789518223.148796:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627498880:0@lo:400:kworker.0 00000100:00100000:1.0:1789518223.148822:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518223.148949:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789518223.148956:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627499008:0@lo:400:kworker.0 00000100:00100000:1.0:1789518223.148978:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518223.149065:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627498880 00000100:00100000:2.0:1789518223.149070:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627498880 00000100:00100000:2.0:1789518223.149096:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627499008 00000100:00100000:2.0:1789518223.149099:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627499008 00000100:00100000:2.0:1789518223.149133:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789518223.149139:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627498880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518223.149176:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627498880:12345-0@lo:400:kworker.0 Request processed in 36us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518223.149182:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789518223.149195:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789518223.149201:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627499008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518223.149230:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627499008:12345-0@lo:400:kworker.0 Request processed in 29us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518223.149235:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1789518223.149278:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789518223.149329:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99fff7a7b100 x1876445627499008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518223.149340:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627499008:0@lo:400:kworker.0 00010000:00080000:1.0:1789518223.149349:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99fff7a7b800 x1876445627498880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518223.149357:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627498880:0@lo:400:kworker.0 00000100:00100000:1.0:1789518223.149374:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627498752:0@lo:8:kworker.0 00000100:00100000:1.0:1789518223.149398:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518223.149486:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627498752 00000100:00100000:2.0:1789518223.149490:0:15092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627498752 00000100:00100000:2.0:1789518223.149547:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789518223.149552:0:15092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3279:x1876445627498752:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789518223.149678:0:15092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3279:x1876445627498752:12345-0@lo:8:kworker.0 Request processed in 123us (279us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789518223.149684:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789518223.149756:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789518223.149761:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffd1033000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789518223.149765:0:3279:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789518223.149768:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627498752:0@lo:8:kworker.0 00000040:00080000:0.0:1789518223.150041:0:15819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1789518223.150641:0:15808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1789518223.150668:0:15808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789518223.150685:0:15808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bcc00/0x631fd8698c781efb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781f02 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.150696:0:15808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffed5bcc00/0x631fd8698c781efb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781f02 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789518223.150740:0:15808:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789518223.150741:0:15808:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789518223.150743:0:15808:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789518223.150744:0:15808:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789518223.150746:0:15808:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789518223.150747:0:15808:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789518223.150748:0:15808:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789518223.150750:0:15808:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789518223.150751:0:15808:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789518223.150755:0:15808:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1789518223.150757:0:15808:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789518223.150758:0:15808:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789518223.150759:0:15808:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789518223.150760:0:15808:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789518223.150761:0:15808:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789518223.150762:0:15808:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789518223.150763:0:15808:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789518223.150764:0:15808:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789518223.150765:0:15808:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789518223.150783:0:15808:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789518223.150798:0:15808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15808:1876445627499136:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789518223.150920:0:15808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518223.150956:0:15808:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0f65d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789518223.151129:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627499136 00000100:00100000:3.0:1789518223.151135:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627499136 00000100:00100000:3.0:1789518223.151178:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789518223.151186:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4229050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+19:15808:x1876445627499136:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789518223.151216:0:14403:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789518223.151228:0:14403:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789518223.179085:0:14403:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789518223.179106:0:14403:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789518223.179237:0:14425:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789518223.179242:0:14425:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789518223.179274:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ffed5bd400/0x631fd8698c781f1e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.179292:0:14425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c781df1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c781dea expref: 19 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.179300:0:14425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ffed5bd400/0x631fd8698c781f1e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.179338:0:14425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c781df1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c781dea expref: 19 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.179352:0:14425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c781df1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c781dea expref: 19 pid: 14403 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518223.179366:0:14425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14425:1876445627499264:0@lo:104: 00000100:00100000:0.0:1789518223.179427:0:14425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518223.179981:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627499264 00000100:00100000:3.0:1789518223.179990:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627499264 00000100:00100000:3.0:1789518223.180043:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789518223.180054:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+3:14425:x1876445627499264:12345-0@lo:104: 00000100:00100000:0.0:1789518223.180064:0:14425:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc9184e40 going to sleep for 11 seconds 00010000:00010000:3.0:1789518223.180067:0:14394:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17800/0x631fd8698c781dea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c781df1 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518223.180138:0:14394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789518223.180145:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+3:14425:x1876445627499264:12345-0@lo:104: Request processed in 93us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518223.180152:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789518223.180178:0:14425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14425:1876445627499264:0@lo:104: 00010000:00010000:0.0:1789518223.180211:0:14425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ffed5bd400/0x631fd8698c781f1e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.180305:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518223.180312:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17800/0x631fd8698c781dea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c781df1 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.180320:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17800 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:2.0:1789518223.180324:0:14399:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17800/0x631fd8698c781dea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c781df1 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.180332:0:14399:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17800/0x631fd8698c781dea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c781df1 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518223.180353:0:14399:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17800/0x631fd8698c781dea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c781df1 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518223.180359:0:14399:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789518223.180393:0:14399:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17800/0x631fd8698c781dea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c781df1 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.180400:0:14399:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789518223.180426:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17800/0x631fd8698c781dea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c781df1 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.180434:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17800/0x631fd8698c781dea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c781df1 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.180450:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518223.180452:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518223.180454:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518223.180498:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a262dbd-f283-43e3-b7fd-ac44d37658cb:3282:1876445627499392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518223.180527:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518223.180843:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627499392 00000100:00100000:2.0:1789518223.180848:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627499392 00010000:00010000:2.0:1789518223.180882:0:14396:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c781df1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c781dea expref: 20 pid: 14403 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518223.180910:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789518223.180918:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+20:3282:x1876445627499392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789518223.180928:0:14396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518223.180934:0:14396:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c781df1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c781dea expref: 20 pid: 14403 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.180944:0:14396:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c781df1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c781dea expref: 20 pid: 14403 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.180964:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c781df1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c781dea expref: 20 pid: 14403 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.180977:0:14396:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ffed5bd400/0x631fd8698c781f1e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.180984:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bd400/0x631fd8698c781f1e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789518223.180996:0:14396:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001754321s 00010000:00010000:2.0:1789518223.181000:0:14396:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffed5bd400/0x631fd8698c781f1e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.181006:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffed5bd400/0x631fd8698c781f1e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.181013:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ffed5bd400/0x631fd8698c781f1e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.181019:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ffed5bd400/0x631fd8698c781f1e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.181024:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518223.181028:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ffed5bd400/0x631fd8698c781f1e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.181034:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ffed5bd400/0x631fd8698c781f1e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.181052:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ffed5bd400/0x631fd8698c781f1e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518223.181067:0:14396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518223.181102:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+19:3282:x1876445627499392:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518223.181109:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1789518223.181341:0:14425:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ffed5bd400/0x631fd8698c781f1e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.181349:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ffed5bd400/0x631fd8698c781f1e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518223.181356:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffed5bd400/0x631fd8698c781f1e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518223.181398:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a262dbd-f283-43e3-b7fd-ac44d37658cb:3282:1876445627499392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518223.192765:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4229050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+18:15808:x1876445627499136:12345-0@lo:253:mount.lustre.0 Request processed in 41571us (41836us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518223.192780:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789518223.192786:0:15808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a262dbd-f283-43e3-b7fd-ac44d37658cb:15808:1876445627499136:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789518223.192802:0:15808:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789518223.192806:0:15808:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789518223.192808:0:15808:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789518223.192809:0:15808:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789518223.192810:0:15808:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789518223.192812:0:15808:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789518223.192813:0:15808:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789518223.192814:0:15808:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789518223.192816:0:15808:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789518223.192818:0:15808:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789518223.192834:0:15808:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789518223.193328:0:15808:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789518223.193494:0:15808:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789518223.193716:0:15808:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789518223.193873:0:15808:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789518223.194024:0:15808:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789518223.194415:0:15808:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789518223.196842:0:15808:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1789518223.252484:0:15808:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1789518223.252492:0:15808:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1789518223.252525:0:15808:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789518223.252648:0:15808:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.151@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789518223.252666:0:15808:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1789518223.252691:0:15808:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:0.0:1789518223.986770:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789518223.986791:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627499520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518223.986853:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518223.987011:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627499520 00000100:00100000:2.0:1789518223.987019:0:15096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627499520 00000100:00100000:2.0:1789518223.987063:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789518223.987071:0:15096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627499520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789518223.987103:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789518223.987157:0:15096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627499520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518223.987177:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789518223.987287:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627499520:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789518224.117650:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789518224.626730:0:14407:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789518224.626739:0:14407:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99ffd8b25000 from 8 10000000:01000000:3.0:1789518224.626745:0:14407:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789518224.626822:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17c00/0x631fd8698c781f25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518224.626837:0:14407:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17c00/0x631fd8698c781f25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518224.626850:0:14407:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17c00/0x631fd8698c781f25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518224.626885:0:14407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14407:1876445627499648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789518224.626993:0:14407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518224.627060:0:14407:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc76c4840 going to sleep for 11 seconds 00000100:00100000:1.0:1789518224.627294:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627499648 00000100:00100000:1.0:1789518224.627303:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627499648 00000100:00100000:1.0:1789518224.627361:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789518224.627372:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff422a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+18:14407:x1876445627499648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518224.627388:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518224.627404:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc2f6800/0x631fd8698c781f2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c781f25 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518224.627434:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc2f6800/0x631fd8698c781f2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c781f25 expref: 19 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518224.627445:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc2f6800/0x631fd8698c781f2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c781f25 expref: 19 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518224.627456:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f6800, rc 0) 00000100:00100000:1.0:1789518224.627508:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff422a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+19:14407:x1876445627499648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518224.627516:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789518224.627721:0:14407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14407:1876445627499648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518224.627737:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17c00/0x631fd8698c781f25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781f2c expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518224.627746:0:14407:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17c00/0x631fd8698c781f25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c781f2c expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518224.627900:0:14407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14407:1876445627499776:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789518224.627941:0:14407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518224.628003:0:14407:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc76c4840 going to sleep for 11 seconds 00000100:00100000:0.0:1789518224.628935:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627499776 00000100:00100000:0.0:1789518224.628946:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627499776 00000100:00100000:0.0:1789518224.629004:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789518224.629015:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff422ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+19:14407:x1876445627499776:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789518224.629044:0:14403:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789518224.629069:0:14403:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789518224.629073:0:14403:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1789518224.629272:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff422ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+19:14407:x1876445627499776:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 259us (1330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518224.629281:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789518224.629530:0:14407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14407:1876445627499776:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789518224.629653:0:14407:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789518224.629663:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17c00/0x631fd8698c781f25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781f2c expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518224.629676:0:14407:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17c00/0x631fd8698c781f25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c781f2c expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518225.141155:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518226.162844:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789518226.682004:0:16163:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789518227.188559:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518227.907920:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518227.909031:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617032448 00000100:00100000:2.0:1789518227.909041:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617032448 00000100:00100000:2.0:1789518227.909079:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 71 00000100:00100000:2.0:1789518227.909086:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4228850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2341:x1876445617032448:12345-192.168.206.51@tcp:250:mount.lustre.0 00010000:00080000:2.0:1789518227.909220:0:14405:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 17615ede-c250-4a03-8ccd-330fab022941@192.168.206.51@tcp t0 exp 0000000000000000 cur 281 last 0 00000020:00000080:2.0:1789518227.909246:0:14405:0:(genops.c:1384:class_connect()) connect: client 17615ede-c250-4a03-8ccd-330fab022941, cookie 0x631fd8698c781f33 00000100:00080000:2.0:1789518227.909525:0:14405:0:(import.c:65:import_set_state_nolock()) ffff99fffd262000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789518227.909605:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4228850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17615ede-c250-4a03-8ccd-330fab022941+5:2341:x1876445617032448:12345-192.168.206.51@tcp:250:mount.lustre.0 Request processed in 517us (1692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518227.909640:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 71 00000100:00100000:2.0:1789518227.911489:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518227.911600:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617032576 00000100:00100000:1.0:1789518227.911608:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617032576 00000100:00100000:1.0:1789518227.911669:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:1.0:1789518227.911676:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe0149050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17615ede-c250-4a03-8ccd-330fab022941+5:13702:x1876445617032576:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789518227.911700:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518227.911717:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc2f6200/0x631fd8698c781f3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcad2 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518227.911743:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc2f6200/0x631fd8698c781f3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcad2 expref: 6 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518227.911754:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc2f6200/0x631fd8698c781f3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcad2 expref: 6 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518227.911762:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f6200, rc 0) 00000100:00100000:1.0:1789518227.911811:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe0149050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17615ede-c250-4a03-8ccd-330fab022941+6:13702:x1876445617032576:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 133us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518227.911818:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:0.0:1789518227.914343:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518227.914441:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617032704 00000100:00100000:2.0:1789518227.914449:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617032704 00000100:00100000:2.0:1789518227.915216:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:2.0:1789518227.915225:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe014ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17615ede-c250-4a03-8ccd-330fab022941+6:13702:x1876445617032704:12345-192.168.206.51@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789518227.915527:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe014ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17615ede-c250-4a03-8ccd-330fab022941+6:13702:x1876445617032704:12345-192.168.206.51@tcp:501:mount.lustre.0 Request processed in 302us (1191us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789518227.915535:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:0.0:1789518227.918173:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518227.918514:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617032832 00000100:00100000:1.0:1789518227.918528:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617032832 00000100:00100000:1.0:1789518227.918600:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00100000:1.0:1789518227.918610:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe014bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17615ede-c250-4a03-8ccd-330fab022941+6:13702:x1876445617032832:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789518227.918662:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518227.918681:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc2f7c00/0x631fd8698c781f41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcad9 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518227.918709:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc2f7c00/0x631fd8698c781f41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcad9 expref: 7 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518227.918721:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc2f7c00/0x631fd8698c781f41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcad9 expref: 7 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518227.918748:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f7c00, rc 0) 00000100:00100000:1.0:1789518227.918795:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe014bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17615ede-c250-4a03-8ccd-330fab022941+7:13702:x1876445617032832:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 187us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518227.918802:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00100000:1.0:1789518227.922198:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518227.922372:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617032960 00000100:00100000:0.0:1789518227.922385:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617032960 00000100:00100000:0.0:1789518227.922521:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00100000:0.0:1789518227.922531:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe014a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17615ede-c250-4a03-8ccd-330fab022941+7:13702:x1876445617032960:12345-192.168.206.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789518227.922852:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe014a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17615ede-c250-4a03-8ccd-330fab022941+8:13702:x1876445617032960:12345-192.168.206.51@tcp:501:mount.lustre.0 Request processed in 321us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518227.922860:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00100000:0.0:1789518227.924410:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518227.925999:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617033088 00000100:00100000:1.0:1789518227.926011:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617033088 00000100:00100000:1.0:1789518227.926075:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00100000:1.0:1789518227.926086:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe0148c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17615ede-c250-4a03-8ccd-330fab022941+8:13702:x1876445617033088:12345-192.168.206.51@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789518227.926413:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe0148c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17615ede-c250-4a03-8ccd-330fab022941+8:13702:x1876445617033088:12345-192.168.206.51@tcp:503:mount.lustre.0 Request processed in 327us (2008us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518227.926421:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00100000:1.0:1789518227.930922:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518227.931037:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617033216 00000100:00100000:0.0:1789518227.931045:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617033216 00000100:00100000:0.0:1789518227.931160:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:0.0:1789518227.931170:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe0149450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17615ede-c250-4a03-8ccd-330fab022941+8:13720:x1876445617033216:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789518227.931542:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe0149450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17615ede-c250-4a03-8ccd-330fab022941+8:13720:x1876445617033216:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 373us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518227.931562:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:2.0:1789518227.948019:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518227.948098:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617033344 00000100:00100000:1.0:1789518227.948109:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617033344 00000100:00100000:1.0:1789518227.948167:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:1.0:1789518227.948177:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe014b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17615ede-c250-4a03-8ccd-330fab022941+8:13720:x1876445617033344:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789518227.948673:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe014b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17615ede-c250-4a03-8ccd-330fab022941+8:13720:x1876445617033344:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 495us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518227.948681:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:1.0:1789518227.953931:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518227.954043:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617033472 00000100:00100000:0.0:1789518227.954052:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617033472 00000100:00100000:0.0:1789518227.954104:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 79 00000100:00100000:0.0:1789518227.954113:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe0149850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17615ede-c250-4a03-8ccd-330fab022941+8:13702:x1876445617033472:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789518227.954127:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518227.954143:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffed5bd600/0x631fd8698c781f48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcb03 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.954170:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bd600/0x631fd8698c781f48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcb03 expref: 9 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.954180:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffed5bd600/0x631fd8698c781f48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcb03 expref: 9 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518227.954208:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd600, rc 0) 00000100:00100000:0.0:1789518227.954266:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe0149850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17615ede-c250-4a03-8ccd-330fab022941+9:13702:x1876445617033472:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 153us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518227.954425:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 79 00000100:00100000:0.0:1789518227.960241:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518227.960322:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617033600 00000100:00100000:1.0:1789518227.960330:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617033600 00000100:00100000:1.0:1789518227.960368:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:1.0:1789518227.960374:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe014a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17615ede-c250-4a03-8ccd-330fab022941+9:13702:x1876445617033600:12345-192.168.206.51@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789518227.960404:0:14404:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789518227.960416:0:14404:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789518227.960419:0:14404:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789518227.960421:0:14404:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789518227.960422:0:14404:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1789518227.962830:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe014a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17615ede-c250-4a03-8ccd-330fab022941+9:13702:x1876445617033600:12345-192.168.206.51@tcp:256:mount.lustre.0 Request processed in 2446us (2587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518227.962842:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:2.0:1789518227.965405:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518227.965522:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617033728 00000100:00100000:1.0:1789518227.965531:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617033728 00000100:00100000:1.0:1789518227.965732:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:1.0:1789518227.965743:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe0149c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17615ede-c250-4a03-8ccd-330fab022941+9:13702:x1876445617033728:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789518227.965759:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518227.965775:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc2f7800/0x631fd8698c781f4f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcb0a expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518227.965801:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc2f7800/0x631fd8698c781f4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcb0a expref: 10 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518227.965811:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc2f7800/0x631fd8698c781f4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcb0a expref: 10 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518227.965820:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f7800, rc 0) 00000100:00100000:1.0:1789518227.965912:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe0149c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17615ede-c250-4a03-8ccd-330fab022941+10:13702:x1876445617033728:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 171us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518227.965919:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:1.0:1789518227.968172:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518227.968308:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617033856 00000100:00100000:0.0:1789518227.968317:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617033856 00000100:00100000:0.0:1789518227.968415:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 82 00000100:00100000:0.0:1789518227.968425:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe014a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17615ede-c250-4a03-8ccd-330fab022941+10:13702:x1876445617033856:12345-192.168.206.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789518227.968780:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe014a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17615ede-c250-4a03-8ccd-330fab022941+10:13702:x1876445617033856:12345-192.168.206.51@tcp:501:mount.lustre.0 Request processed in 355us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518227.968788:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 82 00000100:00100000:2.0:1789518227.970478:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518227.970544:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617033984 00000100:00100000:1.0:1789518227.970565:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617033984 00000100:00100000:1.0:1789518227.970647:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 83 00000100:00100000:1.0:1789518227.970657:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe0148450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17615ede-c250-4a03-8ccd-330fab022941+10:13702:x1876445617033984:12345-192.168.206.51@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789518227.970977:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe0148450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17615ede-c250-4a03-8ccd-330fab022941+10:13702:x1876445617033984:12345-192.168.206.51@tcp:503:mount.lustre.0 Request processed in 320us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518227.970984:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 83 00000100:00100000:2.0:1789518227.975015:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518227.975307:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617034112 00000100:00100000:0.0:1789518227.975316:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617034112 00000100:00100000:0.0:1789518227.975361:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 84 00000100:00100000:0.0:1789518227.975371:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe014b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17615ede-c250-4a03-8ccd-330fab022941+10:13724:x1876445617034112:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789518227.975671:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe014b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17615ede-c250-4a03-8ccd-330fab022941+10:13724:x1876445617034112:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 301us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518227.975680:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 84 00000100:00100000:0.0:1789518227.979824:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518227.979920:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617034240 00000100:00100000:1.0:1789518227.979930:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617034240 00000100:00100000:1.0:1789518227.979982:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 85 00000100:00100000:1.0:1789518227.979992:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe014b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17615ede-c250-4a03-8ccd-330fab022941+10:13724:x1876445617034240:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789518227.980215:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe014b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17615ede-c250-4a03-8ccd-330fab022941+10:13724:x1876445617034240:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 224us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518227.980224:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 85 00000100:00100000:2.0:1789518227.989522:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518227.989781:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617034368 00000100:00100000:1.0:1789518227.989791:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617034368 00000100:00100000:1.0:1789518227.989844:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:1.0:1789518227.989852:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2341:x1876445617034368:12345-192.168.206.51@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789518227.989878:0:14410:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from aa777a5b-38aa-4d6a-adfe-237c479e59ff@192.168.206.51@tcp t0 exp 0000000000000000 cur 281 last 0 00000020:00000080:1.0:1789518227.989920:0:14410:0:(genops.c:1384:class_connect()) connect: client aa777a5b-38aa-4d6a-adfe-237c479e59ff, cookie 0x631fd8698c781f56 00000004:00100000:1.0:1789518227.989947:0:14410:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1789518227.989954:0:14410:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1789518228.016410:0:14410:0:(import.c:65:import_set_state_nolock()) ffff99fffd261800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789518228.016538:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+6:2341:x1876445617034368:12345-192.168.206.51@tcp:38:mount.lustre.0 Request processed in 26684us (27024us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518228.016558:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:3.0:1789518228.019528:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518228.019596:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518228.019639:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617034496 00000100:00100000:1.0:1789518228.019652:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617034496 00000100:00100000:1.0:1789518228.019707:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617034624 00000100:00100000:1.0:1789518228.019711:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617034624 00000100:00100000:1.0:1789518228.019733:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:1.0:1789518228.019742:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa777a5b-38aa-4d6a-adfe-237c479e59ff+7:0:x1876445617034496:12345-192.168.206.51@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789518228.019779:0:14411:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789518228.019863:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa777a5b-38aa-4d6a-adfe-237c479e59ff+7:0:x1876445617034496:12345-192.168.206.51@tcp:41:mount.lustre.0 Request processed in 122us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518228.019870:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:1.0:1789518228.019888:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:1.0:1789518228.019895:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa777a5b-38aa-4d6a-adfe-237c479e59ff+6:13702:x1876445617034624:12345-192.168.206.51@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789518228.019919:0:14411:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789518228.019942:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa777a5b-38aa-4d6a-adfe-237c479e59ff+6:13702:x1876445617034624:12345-192.168.206.51@tcp:41:mount.lustre.0 Request processed in 47us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518228.019948:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00080000:3.0:1789518228.020337:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518228.025416:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518228.025646:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617034752 00000100:00100000:2.0:1789518228.025656:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617034752 00000100:00100000:2.0:1789518228.025772:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:2.0:1789518228.025783:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+6:13702:x1876445617034752:12345-192.168.206.51@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789518228.025881:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+6:13702:x1876445617034752:12345-192.168.206.51@tcp:40:mount.lustre.0 Request processed in 100us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518228.025889:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:1.0:1789518228.029711:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518228.029752:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518228.029782:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518228.029855:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617035136 00000100:00100000:2.0:1789518228.029865:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617035136 00000100:00100000:2.0:1789518228.029923:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:2.0:1789518228.029931:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+6:13702:x1876445617035136:12345-192.168.206.51@tcp:33:mount.lustre.0 00000100:00100000:3.0:1789518228.029942:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617034880 00000100:00100000:0.0:1789518228.029947:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617035008 00000100:00100000:3.0:1789518228.029948:0:15091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617034880 00000100:00100000:0.0:1789518228.029951:0:15093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617035008 00000100:00100000:3.0:1789518228.029982:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:3.0:1789518228.029990:0:15091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2976300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2341:x1876445617034880:12345-192.168.206.51@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789518228.030114:0:15091:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from aa777a5b-38aa-4d6a-adfe-237c479e59ff@192.168.206.51@tcp t0 exp 0000000000000000 cur 282 last 0 00000020:00000080:3.0:1789518228.030247:0:15091:0:(genops.c:1384:class_connect()) connect: client aa777a5b-38aa-4d6a-adfe-237c479e59ff, cookie 0x631fd8698c781f5d 00002000:00100000:3.0:1789518228.030370:0:15091:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli aa777a5b-38aa-4d6a-adfe-237c479e59ff/ffff99fffd240800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789518228.030392:0:15091:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789518228.031415:0:15091:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789518228.031448:0:15091:0:(import.c:65:import_set_state_nolock()) ffff99fffd244000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789518228.031519:0:15091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2976300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+6:2341:x1876445617034880:12345-192.168.206.51@tcp:8:mount.lustre.0 Request processed in 1528us (1766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518228.031528:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:3.0:1789518228.031574:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:3.0:1789518228.031580:0:15091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2341:x1876445617035008:12345-192.168.206.51@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789518228.031599:0:15091:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from aa777a5b-38aa-4d6a-adfe-237c479e59ff@192.168.206.51@tcp t0 exp 0000000000000000 cur 282 last 0 00000020:00000080:3.0:1789518228.031636:0:15091:0:(genops.c:1384:class_connect()) connect: client aa777a5b-38aa-4d6a-adfe-237c479e59ff, cookie 0x631fd8698c781f64 00002000:00100000:3.0:1789518228.031644:0:15091:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli aa777a5b-38aa-4d6a-adfe-237c479e59ff/ffff99fffd246000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789518228.031661:0:15091:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789518228.031871:0:15091:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789518228.031887:0:15091:0:(import.c:65:import_set_state_nolock()) ffff99fffd244800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789518228.031912:0:15091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+6:2341:x1876445617035008:12345-192.168.206.51@tcp:8:mount.lustre.0 Request processed in 331us (2130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518228.031918:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00000004:00080000:2.0:1789518228.032607:0:14412:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2623us 00000004:00200000:2.0:1789518228.041941:0:14412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789518228.042143:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+6:13702:x1876445617035136:12345-192.168.206.51@tcp:33:mount.lustre.0 Request processed in 12206us (12447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518228.042153:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:1.0:1789518228.148784:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518228.148943:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617035264 00000100:00100000:0.0:1789518228.148952:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617035264 00000100:00100000:0.0:1789518228.149009:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:0.0:1789518228.149019:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa777a5b-38aa-4d6a-adfe-237c479e59ff+6:13745:x1876445617035264:12345-192.168.206.51@tcp:101:mkdir.0 00010000:00010000:0.0:1789518228.149038:0:15115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518228.149061:0:15115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c781f6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcb34 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.149124:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c781f72 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.149148:0:15115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c781f72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.149162:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c781f72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518228.149194:0:15115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789518228.149198:0:15115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518228.149231:0:15115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c781f72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.149265:0:15115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c781f6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcb34 expref: 8 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.149282:0:15115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c781f72 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcb34 expref: 7 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.149291:0:15115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffd2a17100) 00010000:00010000:0.0:1789518228.149305:0:15115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789518228.149467:0:15115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd400, rc 0) 00000100:00100000:0.0:1789518228.149527:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa777a5b-38aa-4d6a-adfe-237c479e59ff+7:13745:x1876445617035264:12345-192.168.206.51@tcp:101:mkdir.0 Request processed in 509us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518228.149534:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00010000:00010000:0.0:1789518228.210940:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518228.595018:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a262dbd-f283-43e3-b7fd-ac44d37658cb:3280:1876445627499904:0@lo:400:kworker.0 00000100:00100000:2.0:1789518228.595095:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518228.595233:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627499904 00000100:00100000:0.0:1789518228.595241:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627499904 00000100:00100000:0.0:1789518228.595287:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789518228.595295:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed7c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+19:3280:x1876445627499904:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789518228.596205:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789518228.596212:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789518228.596215:0:8:0:(import.c:65:import_set_state_nolock()) ffff99ffd1033000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1789518228.596224:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a262dbd-f283-43e3-b7fd-ac44d37658cb:3280:1876445627499904:0@lo:400:kworker.0 00000100:00080000:1.0:1789518228.596224:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99ffd1033000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1789518228.596224:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed7c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+19:3280:x1876445627499904:12345-0@lo:400:kworker.0 Request processed in 926us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518228.596240:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789518228.596252:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627500032:0@lo:400:kworker.0 00000100:00100000:1.0:1789518228.596292:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518228.596316:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627500032 00000100:00100000:2.0:1789518228.596328:0:15092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627500032 00000100:00100000:2.0:1789518228.596374:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789518228.596381:0:15092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627500032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518228.596423:0:15092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627500032:12345-0@lo:400:kworker.0 Request processed in 43us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518228.596429:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789518228.596450:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fec1b9f800 x1876445627500160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789518228.596458:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627500032:0@lo:400:kworker.0 00000100:00100000:2.0:1789518228.596509:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627500288:0@lo:400:kworker.0 00000100:00100000:0.0:1789518228.596536:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627500416:0@lo:400:kworker.0 00000100:00100000:2.0:1789518228.596558:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518228.596585:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518228.596628:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789518228.596636:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627500544:0@lo:400:kworker.0 00000100:00100000:0.0:1789518228.596662:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789518228.596665:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518228.596683:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627500160:0@lo:8:kworker.0 00000100:00100000:0.0:1789518228.596700:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627500288 00000100:00100000:0.0:1789518228.596705:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627500288 00000100:00100000:0.0:1789518228.596731:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627500416 00000100:00100000:0.0:1789518228.596734:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627500416 00000100:00100000:0.0:1789518228.596752:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627500544 00000100:00100000:0.0:1789518228.596755:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627500544 00000100:00100000:0.0:1789518228.596777:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789518228.596785:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627500288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518228.596787:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518228.596823:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789518228.596839:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627500288:12345-0@lo:400:kworker.0 Request processed in 54us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518228.596843:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789518228.596845:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627500416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518228.596852:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627500544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518228.596857:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1789518228.596879:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518228.596889:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627500544:12345-0@lo:400:kworker.0 Request processed in 37us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518228.596889:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627500416:12345-0@lo:400:kworker.0 Request processed in 47us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518228.596908:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627500288:0@lo:400:kworker.0 00000100:00100000:2.0:1789518228.596909:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789518228.596954:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627500416:0@lo:400:kworker.0 00000100:00100000:2.0:1789518228.596957:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627500544:0@lo:400:kworker.0 00000100:00100000:2.0:1789518228.596994:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627500160 00000100:00100000:2.0:1789518228.596998:0:15091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627500160 00000100:00100000:2.0:1789518228.597020:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789518228.597024:0:15091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2976d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3279:x1876445627500160:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789518228.597045:0:15091:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 282 last 0 00000020:00000080:2.0:1789518228.597071:0:15091:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x631fd8698c781f79 00002000:00100000:2.0:1789518228.597083:0:15091:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99ffd1036000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789518228.597087:0:15091:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1789518228.597090:0:15091:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1789518228.597128:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00002000:00080000:2.0:1789518228.597349:0:15091:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789518228.597385:0:15091:0:(import.c:65:import_set_state_nolock()) ffff99fff4595000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789518228.597432:0:15091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2976d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3279:x1876445627500160:12345-0@lo:8:kworker.0 Request processed in 406us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518228.597439:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789518228.597465:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fec1b9f800 x1876445627500160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789518248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789518228.597477:0:3279:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789518228.597484:0:3279:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789518228.597488:0:3279:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789518228.597490:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffd1033000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789518228.597515:0:3279:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789518228.597520:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627500160:0@lo:8:kworker.0 00000004:00080000:0.0:1789518228.597743:0:14433:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789518228.597918:0:14434:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:2.0:1789518228.597937:0:14434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a79180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14434:1876445627500800:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789518228.597969:0:14434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518228.597984:0:14434:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffdfffbb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789518228.598002:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789518228.598015:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627500672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518228.598038:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518228.598059:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627500672 00000100:00100000:2.0:1789518228.598063:0:15096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627500672 00000100:00100000:2.0:1789518228.598097:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789518228.598102:0:15096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627500672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789518228.598111:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44367872 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789518228.598134:0:15096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627500672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518228.598137:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789518228.598159:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fff7a78380 x1876445627500672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518228.598172:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627500672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518228.598195:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627500800 00000100:00100000:2.0:1789518228.598200:0:15093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627500800 00000100:00100000:2.0:1789518228.598230:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789518228.598239:0:15093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14434:x1876445627500800:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:1.0:1789518228.598414:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789518228.598572:0:14433:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 282594956692ns, next at 0ns, rc = 0 00002000:00080000:3.0:1789518228.605655:0:15093:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1789518228.605665:0:15093:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1789518228.605670:0:15093:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:3.0:1789518228.619841:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518228.619857:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1a882a1/0x631fd8698c781f80 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.619874:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=282s v=(0 0) 00010000:00010000:3.0:1789518228.619879:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518228.619885:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1a882a1/0x631fd8698c781f80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.619903:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1a882a1/0x631fd8698c781f80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.619915:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1a882a1/0x631fd8698c781f80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.619924:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1a882a1/0x631fd8698c781f80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.619946:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789518228.620434:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518228.620441:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034f91c82/0x631fd8698c781f87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.620451:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=282s v=(0 0) 00010000:00010000:3.0:1789518228.620454:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518228.620458:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034f91c82/0x631fd8698c781f87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.620468:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034f91c82/0x631fd8698c781f87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.620483:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034f91c82/0x631fd8698c781f87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.620491:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034f91c82/0x631fd8698c781f87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.620506:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789518228.620517:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789518228.620522:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1a882a1/0x631fd8698c781f80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.620530:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518228.620534:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1a882a1/0x631fd8698c781f80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.620555:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1a882a1/0x631fd8698c781f80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.620571:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1a882a1/0x631fd8698c781f80 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.620578:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1a882a1/0x631fd8698c781f80 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.620596:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518228.620606:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034f91c82/0x631fd8698c781f87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.620649:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16a00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518228.620653:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034f91c82/0x631fd8698c781f87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.620662:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034f91c82/0x631fd8698c781f87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.620674:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034f91c82/0x631fd8698c781f87 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.620677:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518228.620684:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034f91c82/0x631fd8698c781f87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.620697:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518228.620699:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518228.620701:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518228.621162:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518228.621168:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0a9c375/0x631fd8698c781f8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.621177:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=282s v=(0 0) 00010000:00010000:3.0:1789518228.621181:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518228.621185:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0a9c375/0x631fd8698c781f8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.621208:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0a9c375/0x631fd8698c781f8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.621217:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0a9c375/0x631fd8698c781f8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.621224:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0a9c375/0x631fd8698c781f8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.621246:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518228.621257:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518228.621275:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0a9c375/0x631fd8698c781f8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.621285:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16c00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518228.621289:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0a9c375/0x631fd8698c781f8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.621298:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0a9c375/0x631fd8698c781f8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.621314:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0a9c375/0x631fd8698c781f8e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.621323:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0a9c375/0x631fd8698c781f8e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.621347:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518228.621350:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518228.621352:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518228.621712:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518228.621718:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002379b8dd/0x631fd8698c781f95 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.621727:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=282s v=(0 0) 00010000:00010000:3.0:1789518228.621730:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518228.621734:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002379b8dd/0x631fd8698c781f95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.621744:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002379b8dd/0x631fd8698c781f95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.621753:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002379b8dd/0x631fd8698c781f95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.621771:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002379b8dd/0x631fd8698c781f95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.621784:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518228.621792:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518228.621796:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002379b8dd/0x631fd8698c781f95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.621803:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518228.622969:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002379b8dd/0x631fd8698c781f95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.622983:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002379b8dd/0x631fd8698c781f95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.622998:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002379b8dd/0x631fd8698c781f95 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.623006:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002379b8dd/0x631fd8698c781f95 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.623024:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518228.623026:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518228.623028:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789518228.623901:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:00100000:0.0:1789518228.623926:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of aa777a5b-38aa-4d6a-adfe-237c479e59ff 00002000:00010000:3.0:1789518228.624084:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518228.624098:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1a882a1/0x631fd8698c781f9c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.624111:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=282s v=(0 0) 00010000:00010000:3.0:1789518228.624116:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518228.624121:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1a882a1/0x631fd8698c781f9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.624133:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1a882a1/0x631fd8698c781f9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.624142:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1a882a1/0x631fd8698c781f9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.624149:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1a882a1/0x631fd8698c781f9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.624167:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518228.624221:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518228.624228:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1a882a1/0x631fd8698c781f9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.624238:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518228.624242:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1a882a1/0x631fd8698c781f9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.624250:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1a882a1/0x631fd8698c781f9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.624265:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1a882a1/0x631fd8698c781f9c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.624273:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1a882a1/0x631fd8698c781f9c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.624290:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518228.624292:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518228.624296:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789518228.624305:0:7607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aa777a5b-38aa-4d6a-adfe-237c479e59ff 00002000:00010000:3.0:1789518228.624824:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518228.624831:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c781fa3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.624840:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=282s v=(0 0) 00010000:00010000:3.0:1789518228.624843:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518228.624847:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c781fa3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.624857:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c781fa3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.624871:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c781fa3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.624878:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c781fa3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.624945:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518228.624947:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518228.624955:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c781fa3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.624965:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518228.624968:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c781fa3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.624978:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c781fa3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.624994:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c781fa3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.625002:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c781fa3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.625033:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518228.625036:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518228.625039:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518228.625286:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518228.625292:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8f0426e/0x631fd8698c781faa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.625300:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=282s v=(0 0) 00010000:00010000:3.0:1789518228.625304:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518228.625308:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8f0426e/0x631fd8698c781faa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.625316:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8f0426e/0x631fd8698c781faa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.625325:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8f0426e/0x631fd8698c781faa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.625332:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8f0426e/0x631fd8698c781faa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.625393:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789518228.625732:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518228.625743:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2f4a233/0x631fd8698c781fb1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.625752:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=282s v=(0 0) 00010000:00010000:3.0:1789518228.625755:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518228.625759:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2f4a233/0x631fd8698c781fb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.625768:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2f4a233/0x631fd8698c781fb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.625776:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2f4a233/0x631fd8698c781fb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.625782:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2f4a233/0x631fd8698c781fb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.625798:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789518228.625885:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789518228.625891:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8f0426e/0x631fd8698c781faa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.625900:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16e00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518228.625904:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8f0426e/0x631fd8698c781faa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.625914:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8f0426e/0x631fd8698c781faa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.625928:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8f0426e/0x631fd8698c781faa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.625936:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8f0426e/0x631fd8698c781faa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.625956:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518228.625960:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2f4a233/0x631fd8698c781fb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.625967:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17e00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518228.625977:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2f4a233/0x631fd8698c781fb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.625986:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2f4a233/0x631fd8698c781fb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.625998:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2f4a233/0x631fd8698c781fb1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.626007:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2f4a233/0x631fd8698c781fb1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.626023:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518228.626025:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518228.626027:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518228.626184:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518228.626189:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c00b65d5/0x631fd8698c781fb8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.626214:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=282s v=(0 0) 00010000:00010000:3.0:1789518228.626223:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518228.626227:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c00b65d5/0x631fd8698c781fb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.626235:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c00b65d5/0x631fd8698c781fb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.626242:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c00b65d5/0x631fd8698c781fb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.626249:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c00b65d5/0x631fd8698c781fb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.626267:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518228.626327:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518228.626333:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c00b65d5/0x631fd8698c781fb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.626341:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518228.626344:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c00b65d5/0x631fd8698c781fb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.626353:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c00b65d5/0x631fd8698c781fb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.626365:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c00b65d5/0x631fd8698c781fb8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.626379:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c00b65d5/0x631fd8698c781fb8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.626396:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518228.626399:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518228.626400:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518228.626449:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518228.626700:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518228.626707:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d063c167/0x631fd8698c781fbf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.626716:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=282s v=(0 0) 00010000:00010000:3.0:1789518228.626719:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518228.626724:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d063c167/0x631fd8698c781fbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.626734:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d063c167/0x631fd8698c781fbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.626742:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d063c167/0x631fd8698c781fbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.626768:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d063c167/0x631fd8698c781fbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.626785:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518228.626814:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518228.626820:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d063c167/0x631fd8698c781fbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.626828:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518228.626832:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d063c167/0x631fd8698c781fbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.626841:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d063c167/0x631fd8698c781fbf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.626854:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d063c167/0x631fd8698c781fbf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.626861:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d063c167/0x631fd8698c781fbf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.626878:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518228.626881:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518228.626884:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518228.627244:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518228.627250:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044e0d026/0x631fd8698c781fc6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.627258:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=282s v=(0 0) 00010000:00010000:3.0:1789518228.627261:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518228.627265:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044e0d026/0x631fd8698c781fc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.627275:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044e0d026/0x631fd8698c781fc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.627283:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044e0d026/0x631fd8698c781fc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.627291:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044e0d026/0x631fd8698c781fc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.627389:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789518228.627796:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518228.627802:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034f91c82/0x631fd8698c781fcd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.627815:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=282s v=(0 0) 00010000:00010000:3.0:1789518228.627818:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518228.627822:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034f91c82/0x631fd8698c781fcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.627833:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034f91c82/0x631fd8698c781fcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.627841:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034f91c82/0x631fd8698c781fcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.627848:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034f91c82/0x631fd8698c781fcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.627995:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789518228.628005:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044e0d026/0x631fd8698c781fc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.628013:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518228.628017:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044e0d026/0x631fd8698c781fc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.628026:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044e0d026/0x631fd8698c781fc6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.628039:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044e0d026/0x631fd8698c781fc6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.628047:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044e0d026/0x631fd8698c781fc6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.628060:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518228.628064:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034f91c82/0x631fd8698c781fcd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.628071:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16a00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518228.628074:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034f91c82/0x631fd8698c781fcd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.628081:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034f91c82/0x631fd8698c781fcd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.628102:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034f91c82/0x631fd8698c781fcd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.628110:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518228.628111:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518228.628113:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518228.628329:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789518228.628334:0:15093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034f91c82/0x631fd8698c781fcd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.628608:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518228.628877:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518228.628883:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0a9c375/0x631fd8698c781fd4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.628890:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=282s v=(0 0) 00010000:00010000:3.0:1789518228.628892:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518228.628895:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0a9c375/0x631fd8698c781fd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.628910:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0a9c375/0x631fd8698c781fd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.628916:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0a9c375/0x631fd8698c781fd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.628920:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0a9c375/0x631fd8698c781fd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.628931:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518228.628950:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518228.628955:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0a9c375/0x631fd8698c781fd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.629081:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16c00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518228.629085:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0a9c375/0x631fd8698c781fd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.629093:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0a9c375/0x631fd8698c781fd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.629105:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0a9c375/0x631fd8698c781fd4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.629112:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0a9c375/0x631fd8698c781fd4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.629126:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518228.629128:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518228.629129:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518228.629399:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518228.629405:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d45c37ed/0x631fd8698c781fdb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.629413:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=282s v=(0 0) 00010000:00010000:3.0:1789518228.629416:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518228.629433:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d45c37ed/0x631fd8698c781fdb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.629442:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d45c37ed/0x631fd8698c781fdb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.629451:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d45c37ed/0x631fd8698c781fdb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.629475:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d45c37ed/0x631fd8698c781fdb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.629495:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518228.629537:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518228.629543:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d45c37ed/0x631fd8698c781fdb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.629562:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518228.629566:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d45c37ed/0x631fd8698c781fdb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.629573:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d45c37ed/0x631fd8698c781fdb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.629584:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d45c37ed/0x631fd8698c781fdb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.629592:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d45c37ed/0x631fd8698c781fdb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.629606:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518228.629607:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518228.629609:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518228.630029:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518228.630035:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000600444e7/0x631fd8698c781fe2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.630043:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=282s v=(0 0) 00010000:00010000:3.0:1789518228.630046:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518228.630050:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000600444e7/0x631fd8698c781fe2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.630059:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000600444e7/0x631fd8698c781fe2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.630067:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000600444e7/0x631fd8698c781fe2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.630074:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000600444e7/0x631fd8698c781fe2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.630124:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789518228.630479:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518228.630485:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000643cfe4d/0x631fd8698c781fe9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.630499:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=282s v=(0 0) 00010000:00010000:3.0:1789518228.630503:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518228.630507:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000643cfe4d/0x631fd8698c781fe9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.630517:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000643cfe4d/0x631fd8698c781fe9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.630526:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000643cfe4d/0x631fd8698c781fe9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.630534:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000643cfe4d/0x631fd8698c781fe9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.630688:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789518228.630695:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000600444e7/0x631fd8698c781fe2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.630703:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518228.630707:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000600444e7/0x631fd8698c781fe2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.630716:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000600444e7/0x631fd8698c781fe2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.630729:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000600444e7/0x631fd8698c781fe2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.630737:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000600444e7/0x631fd8698c781fe2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.630762:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518228.630766:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000643cfe4d/0x631fd8698c781fe9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.630773:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518228.630776:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000643cfe4d/0x631fd8698c781fe9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.630784:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000643cfe4d/0x631fd8698c781fe9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.630804:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000643cfe4d/0x631fd8698c781fe9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.630812:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518228.630814:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518228.630816:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518228.630913:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518228.630939:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789518228.630946:0:15093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000643cfe4d/0x631fd8698c781fe9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789518228.631331:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518228.631337:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6dd398e/0x631fd8698c781ff0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.631345:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=282s v=(0 0) 00010000:00010000:3.0:1789518228.631349:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518228.631352:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6dd398e/0x631fd8698c781ff0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.631371:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6dd398e/0x631fd8698c781ff0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.631380:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6dd398e/0x631fd8698c781ff0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.631387:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6dd398e/0x631fd8698c781ff0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.631460:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789518228.631862:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518228.631868:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a242002b/0x631fd8698c781ff7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.631876:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=282s v=(0 0) 00010000:00010000:3.0:1789518228.631879:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518228.631883:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a242002b/0x631fd8698c781ff7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.631892:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a242002b/0x631fd8698c781ff7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.631900:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a242002b/0x631fd8698c781ff7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.631920:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a242002b/0x631fd8698c781ff7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.631971:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789518228.631976:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6dd398e/0x631fd8698c781ff0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.631983:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0c00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518228.631987:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6dd398e/0x631fd8698c781ff0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.631995:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6dd398e/0x631fd8698c781ff0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.632006:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6dd398e/0x631fd8698c781ff0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.632013:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6dd398e/0x631fd8698c781ff0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.632027:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518228.632030:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a242002b/0x631fd8698c781ff7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.632046:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0e00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518228.632050:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a242002b/0x631fd8698c781ff7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.632057:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a242002b/0x631fd8698c781ff7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.632067:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a242002b/0x631fd8698c781ff7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.632074:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518228.632076:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518228.632077:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518228.632160:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789518228.632165:0:15093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a242002b/0x631fd8698c781ff7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.632182:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518228.632556:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518228.632562:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ba14c2c/0x631fd8698c781ffe lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.632570:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=282s v=(0 0) 00010000:00010000:3.0:1789518228.632573:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518228.632577:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ba14c2c/0x631fd8698c781ffe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.632586:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ba14c2c/0x631fd8698c781ffe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.632594:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ba14c2c/0x631fd8698c781ffe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.632600:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ba14c2c/0x631fd8698c781ffe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.632730:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789518228.633104:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518228.633110:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001672fcc/0x631fd8698c782005 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.633118:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=282s v=(0 0) 00010000:00010000:3.0:1789518228.633121:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518228.633125:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001672fcc/0x631fd8698c782005 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.633134:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001672fcc/0x631fd8698c782005 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.633142:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001672fcc/0x631fd8698c782005 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.633149:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001672fcc/0x631fd8698c782005 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.633223:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789518228.633228:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ba14c2c/0x631fd8698c781ffe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.633235:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1c00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518228.633238:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ba14c2c/0x631fd8698c781ffe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.633247:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ba14c2c/0x631fd8698c781ffe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.633259:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ba14c2c/0x631fd8698c781ffe lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.633272:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ba14c2c/0x631fd8698c781ffe lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.633287:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518228.633290:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001672fcc/0x631fd8698c782005 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.633297:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1e00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518228.633300:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001672fcc/0x631fd8698c782005 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.633308:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001672fcc/0x631fd8698c782005 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.633318:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001672fcc/0x631fd8698c782005 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.633326:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518228.633328:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518228.633329:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518228.633360:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789518228.633365:0:15093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001672fcc/0x631fd8698c782005 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518228.633382:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518228.634329:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518228.634337:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c78200c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.634353:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=282s v=(0 0) 00010000:00010000:3.0:1789518228.634357:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518228.634362:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c78200c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.634373:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c78200c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.634382:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c78200c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.634390:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c78200c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.634413:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518228.634579:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518228.634585:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c78200c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.634593:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518228.634601:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c78200c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.634609:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c78200c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.634640:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c78200c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.634647:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c78200c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.634660:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518228.634661:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518228.634663:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518228.634811:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518228.634817:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000102d10c0/0x631fd8698c782013 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.634825:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=282s v=(0 0) 00010000:00010000:3.0:1789518228.635529:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518228.635536:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000102d10c0/0x631fd8698c782013 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.635560:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000102d10c0/0x631fd8698c782013 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.635583:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000102d10c0/0x631fd8698c782013 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.635592:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000102d10c0/0x631fd8698c782013 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.635687:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518228.636226:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518228.636232:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000102d10c0/0x631fd8698c782013 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.636239:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0a00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518228.636242:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000102d10c0/0x631fd8698c782013 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.636248:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000102d10c0/0x631fd8698c782013 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.636259:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000102d10c0/0x631fd8698c782013 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.636269:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000102d10c0/0x631fd8698c782013 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.636282:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518228.636283:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518228.636284:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518228.637173:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518228.637181:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8718d65/0x631fd8698c78201a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.637192:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=282s v=(0 0) 00010000:00010000:3.0:1789518228.637197:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518228.637201:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8718d65/0x631fd8698c78201a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.637226:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8718d65/0x631fd8698c78201a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.637234:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8718d65/0x631fd8698c78201a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.637241:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8718d65/0x631fd8698c78201a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.637284:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789518228.637718:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518228.637724:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089c68ca2/0x631fd8698c782021 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.637733:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=282s v=(0 0) 00010000:00010000:3.0:1789518228.637736:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518228.637740:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089c68ca2/0x631fd8698c782021 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.637750:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089c68ca2/0x631fd8698c782021 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.637758:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089c68ca2/0x631fd8698c782021 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.637766:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089c68ca2/0x631fd8698c782021 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.637788:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789518228.637890:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789518228.637898:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8718d65/0x631fd8698c78201a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.637906:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518228.637910:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8718d65/0x631fd8698c78201a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.637918:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8718d65/0x631fd8698c78201a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.637936:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8718d65/0x631fd8698c78201a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.637943:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8718d65/0x631fd8698c78201a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.637966:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518228.637969:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089c68ca2/0x631fd8698c782021 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.637975:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518228.637978:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089c68ca2/0x631fd8698c782021 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.637986:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089c68ca2/0x631fd8698c782021 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.638003:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089c68ca2/0x631fd8698c782021 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.638010:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089c68ca2/0x631fd8698c782021 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.638022:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518228.638024:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518228.638026:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518228.638192:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518228.638198:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c782028 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.638207:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=282s v=(0 0) 00010000:00010000:3.0:1789518228.638215:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518228.638219:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c782028 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.638229:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c782028 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.638236:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c782028 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.638244:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c782028 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.638260:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518228.638284:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518228.638290:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c782028 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.638298:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518228.638301:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c782028 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.638309:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c782028 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.638384:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c782028 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.638394:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c782028 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.638418:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518228.638419:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518228.638420:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518228.638449:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518228.638860:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518228.638866:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f1eb917/0x631fd8698c78202f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.638874:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=282s v=(0 0) 00010000:00010000:3.0:1789518228.638877:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518228.638881:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f1eb917/0x631fd8698c78202f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.638890:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f1eb917/0x631fd8698c78202f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.638899:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f1eb917/0x631fd8698c78202f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.638911:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f1eb917/0x631fd8698c78202f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.639315:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518228.639317:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518228.639322:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f1eb917/0x631fd8698c78202f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.639430:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518228.639434:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f1eb917/0x631fd8698c78202f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.639443:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f1eb917/0x631fd8698c78202f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.639456:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f1eb917/0x631fd8698c78202f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.639463:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f1eb917/0x631fd8698c78202f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518228.639483:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518228.639486:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518228.639489:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518228.640476:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518228.640483:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000912b7800/0x631fd8698c782036 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.640493:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=282s v=(0 0) 00010000:00010000:3.0:1789518228.640497:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518228.640500:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000912b7800/0x631fd8698c782036 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.640509:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000912b7800/0x631fd8698c782036 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.640514:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000912b7800/0x631fd8698c782036 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.640532:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000912b7800/0x631fd8698c782036 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518228.640565:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518228.640716:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518228.640724:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000912b7800/0x631fd8698c782036 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.640735:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518228.640739:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000912b7800/0x631fd8698c782036 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.640749:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000912b7800/0x631fd8698c782036 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.640765:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000912b7800/0x631fd8698c782036 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.640773:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000912b7800/0x631fd8698c782036 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518228.640798:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518228.640801:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1789518228.640802:0:15093:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00010000:00010000:1.0:1789518228.640810:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518228.640889:0:15093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14434:x1876445627500800:12345-0@lo:5:osp-pre-1-0.0 Request processed in 42649us (42915us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518228.640907:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789518228.640919:0:14434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a79180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14434:1876445627500800:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789518228.640935:0:14434:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:2.0:1789518228.640986:0:14434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a79180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14434:1876445627500928:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789518228.641019:0:14434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518228.641065:0:14434:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0f65000 going to sleep for 11 seconds 00000100:00100000:3.0:1789518228.641135:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627500928 00000100:00100000:3.0:1789518228.641142:0:15091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627500928 00000100:00100000:3.0:1789518228.641184:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789518228.641193:0:15091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14434:x1876445627500928:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1789518228.641226:0:15091:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1789518228.646530:0:15091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14434:x1876445627500928:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5333us (5504us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789518228.646542:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789518228.646584:0:14434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a79180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14434:1876445627500928:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789518228.646598:0:14434:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1789518229.106863:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627501056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518229.106959:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518229.107070:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627501056 00000100:00100000:1.0:1789518229.107079:0:15096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627501056 00000100:00100000:1.0:1789518229.107200:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789518229.107210:0:15096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627501056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789518229.107230:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789518229.110064:0:15096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627501056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2848us (3096us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518229.110077:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789518229.110205:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627501056:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789518229.235745:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518229.704716:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518229.704882:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617035392 00000100:00100000:2.0:1789518229.704891:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617035392 00000100:00100000:2.0:1789518229.705021:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:2.0:1789518229.705032:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aa777a5b-38aa-4d6a-adfe-237c479e59ff+6:13797:x1876445617035392:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:2.0:1789518229.705054:0:15095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789518229.705138:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aa777a5b-38aa-4d6a-adfe-237c479e59ff+6:13797:x1876445617035392:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 108us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518229.705146:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00080000:1.0:1789518229.705655:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518229.708132:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518229.708215:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617035520 00000100:00100000:3.0:1789518229.708222:0:15096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617035520 00000100:00080000:1.0:1789518229.708287:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518229.708288:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:3.0:1789518229.708301:0:15096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aa777a5b-38aa-4d6a-adfe-237c479e59ff+5:13797:x1876445617035520:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:3.0:1789518229.708325:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789518229.708402:0:15096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aa777a5b-38aa-4d6a-adfe-237c479e59ff+5:13797:x1876445617035520:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 103us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518229.708409:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:0.0:1789518229.801815:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518229.801931:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617035648 00000100:00100000:2.0:1789518229.801941:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617035648 00000100:00100000:2.0:1789518229.802052:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 87 00000100:00100000:2.0:1789518229.802062:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed7c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17615ede-c250-4a03-8ccd-330fab022941+10:13830:x1876445617035648:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789518229.802077:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518229.802093:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc29c8600/0x631fd8698c78203d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcb3b expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518229.802118:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc29c8600/0x631fd8698c78203d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcb3b expref: 11 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518229.802148:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc29c8600/0x631fd8698c78203d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcb3b expref: 11 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518229.802158:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29c8600, rc 0) 00000100:00100000:2.0:1789518229.802214:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed7c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17615ede-c250-4a03-8ccd-330fab022941+11:13830:x1876445617035648:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 154us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518229.802222:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 87 00000100:00100000:0.0:1789518229.811125:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518229.811235:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617035776 00000100:00100000:2.0:1789518229.811243:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617035776 00000100:00100000:2.0:1789518229.811345:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 88 00000100:00100000:2.0:1789518229.811356:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed7c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17615ede-c250-4a03-8ccd-330fab022941+11:13830:x1876445617035776:12345-192.168.206.51@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789518229.811856:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed7c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17615ede-c250-4a03-8ccd-330fab022941+11:13830:x1876445617035776:12345-192.168.206.51@tcp:501:mount.lustre.0 Request processed in 501us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518229.811865:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 88 00000100:00100000:3.0:1789518229.813721:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518229.813965:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617035904 00000100:00100000:2.0:1789518229.813971:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617035904 00000100:00100000:2.0:1789518229.814067:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 89 00000100:00100000:2.0:1789518229.814077:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed7c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17615ede-c250-4a03-8ccd-330fab022941+11:13830:x1876445617035904:12345-192.168.206.51@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789518229.814356:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed7c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17615ede-c250-4a03-8ccd-330fab022941+11:13830:x1876445617035904:12345-192.168.206.51@tcp:503:mount.lustre.0 Request processed in 280us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518229.814368:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 89 00000100:00100000:0.0:1789518229.816712:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518229.816904:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617036032 00000100:00100000:2.0:1789518229.816912:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617036032 00000100:00100000:2.0:1789518229.817010:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 90 00000100:00100000:2.0:1789518229.817020:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed7c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17615ede-c250-4a03-8ccd-330fab022941+11:13836:x1876445617036032:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789518229.817283:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed7c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17615ede-c250-4a03-8ccd-330fab022941+11:13836:x1876445617036032:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 264us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518229.817291:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 90 00000100:00100000:0.0:1789518229.826592:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518229.826749:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617036160 00000100:00100000:2.0:1789518229.826758:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617036160 00000100:00100000:2.0:1789518229.826812:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 91 00000100:00100000:2.0:1789518229.826821:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed7c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17615ede-c250-4a03-8ccd-330fab022941+11:13836:x1876445617036160:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789518229.827077:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed7c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17615ede-c250-4a03-8ccd-330fab022941+11:13836:x1876445617036160:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 256us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518229.827085:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 91 00000100:00100000:3.0:1789518229.830040:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518229.832328:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617036288 00000100:00100000:2.0:1789518229.832340:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617036288 00000100:00100000:2.0:1789518229.832407:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 92 00000100:00100000:2.0:1789518229.832417:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed7c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17615ede-c250-4a03-8ccd-330fab022941+11:13830:x1876445617036288:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789518229.832432:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518229.832450:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc29c8400/0x631fd8698c782044 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcb65 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518229.832476:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc29c8400/0x631fd8698c782044 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcb65 expref: 12 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518229.832488:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc29c8400/0x631fd8698c782044 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcb65 expref: 12 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518229.832496:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29c8400, rc 0) 00000100:00100000:2.0:1789518229.832572:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed7c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17615ede-c250-4a03-8ccd-330fab022941+12:13830:x1876445617036288:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 156us (2540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518229.832591:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 92 00000100:00100000:0.0:1789518229.836230:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518229.836394:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617036416 00000100:00100000:1.0:1789518229.836404:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617036416 00000100:00100000:1.0:1789518229.836485:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 93 00000100:00100000:1.0:1789518229.836496:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed7c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17615ede-c250-4a03-8ccd-330fab022941+12:13830:x1876445617036416:12345-192.168.206.51@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789518229.836519:0:14405:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789518229.836551:0:14405:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789518229.836555:0:14405:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789518229.836559:0:14405:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789518229.836561:0:14405:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1789518229.841346:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed7c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17615ede-c250-4a03-8ccd-330fab022941+12:13830:x1876445617036416:12345-192.168.206.51@tcp:256:mount.lustre.0 Request processed in 4841us (5112us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518229.841360:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 93 00000100:00100000:3.0:1789518229.844502:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518229.844646:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617036544 00000100:00100000:2.0:1789518229.844655:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617036544 00000100:00100000:2.0:1789518229.844706:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 94 00000100:00100000:2.0:1789518229.844715:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed7c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17615ede-c250-4a03-8ccd-330fab022941+12:13830:x1876445617036544:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789518229.844730:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518229.844747:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc29c9200/0x631fd8698c78204b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcb6c expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518229.844772:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc29c9200/0x631fd8698c78204b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcb6c expref: 13 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518229.844902:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc29c9200/0x631fd8698c78204b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcb6c expref: 13 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518229.844912:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29c9200, rc 0) 00000100:00100000:2.0:1789518229.845002:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed7c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17615ede-c250-4a03-8ccd-330fab022941+13:13830:x1876445617036544:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 287us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518229.845010:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 94 00000100:00100000:0.0:1789518229.846840:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518229.846942:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617036672 00000100:00100000:1.0:1789518229.846948:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617036672 00000100:00100000:1.0:1789518229.847007:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 95 00000100:00100000:1.0:1789518229.847014:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed7c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17615ede-c250-4a03-8ccd-330fab022941+13:13830:x1876445617036672:12345-192.168.206.51@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789518229.847258:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed7c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17615ede-c250-4a03-8ccd-330fab022941+13:13830:x1876445617036672:12345-192.168.206.51@tcp:501:mount.lustre.0 Request processed in 242us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518229.847269:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 95 00000100:00100000:0.0:1789518229.848791:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518229.848899:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617036800 00000100:00100000:2.0:1789518229.848907:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617036800 00000100:00100000:2.0:1789518229.848983:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 96 00000100:00100000:2.0:1789518229.849002:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed7c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17615ede-c250-4a03-8ccd-330fab022941+13:13830:x1876445617036800:12345-192.168.206.51@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789518229.849183:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed7c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17615ede-c250-4a03-8ccd-330fab022941+13:13830:x1876445617036800:12345-192.168.206.51@tcp:503:mount.lustre.0 Request processed in 182us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518229.849191:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 96 00000100:00100000:3.0:1789518229.853909:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518229.854002:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617036928 00000100:00100000:1.0:1789518229.854012:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617036928 00000100:00100000:1.0:1789518229.854061:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 97 00000100:00100000:1.0:1789518229.854070:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed7c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17615ede-c250-4a03-8ccd-330fab022941+13:13840:x1876445617036928:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789518229.854292:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed7c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17615ede-c250-4a03-8ccd-330fab022941+13:13840:x1876445617036928:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 222us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518229.854299:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 97 00000100:00100000:1.0:1789518229.860671:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518229.860778:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617037056 00000100:00100000:2.0:1789518229.860787:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617037056 00000100:00100000:2.0:1789518229.860875:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 98 00000100:00100000:2.0:1789518229.860885:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed7c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17615ede-c250-4a03-8ccd-330fab022941+13:13840:x1876445617037056:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789518229.861124:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed7c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17615ede-c250-4a03-8ccd-330fab022941+13:13840:x1876445617037056:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 239us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518229.861132:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 98 00000100:00100000:3.0:1789518229.868882:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518229.868913:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518229.869166:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617037184 00000100:00100000:0.0:1789518229.869176:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617037184 00000100:00100000:0.0:1789518229.869220:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:0.0:1789518229.869229:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2341:x1876445617037184:12345-192.168.206.51@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789518229.869256:0:15115:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from d429a188-2689-4f02-8a27-a318f1cbf37a@192.168.206.51@tcp t0 exp 0000000000000000 cur 283 last 0 00000100:00100000:3.0:1789518229.869276:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000020:00000080:0.0:1789518229.869293:0:15115:0:(genops.c:1384:class_connect()) connect: client d429a188-2689-4f02-8a27-a318f1cbf37a, cookie 0x631fd8698c782052 00000100:00100000:3.0:1789518229.869316:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000004:00100000:0.0:1789518229.869321:0:15115:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1789518229.869342:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617037696 00000100:00100000:3.0:1789518229.869348:0:15092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617037696 00000100:00100000:3.0:1789518229.869386:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617037824 00000100:00100000:3.0:1789518229.869390:0:15092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617037824 00000100:00100000:2.0:1789518229.869392:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617037440 00000100:00100000:3.0:1789518229.869413:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:3.0:1789518229.869435:0:15092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+6:2345:x1876445617037696:12345-192.168.206.51@tcp:400:kworker.0 00000100:00080000:0.0:1789518229.869580:0:15115:0:(import.c:65:import_set_state_nolock()) ffff99fec35a7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789518229.869591:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617037440 00000100:00100000:2.0:1789518229.869649:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:0.0:1789518229.869656:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d429a188-2689-4f02-8a27-a318f1cbf37a+6:2341:x1876445617037184:12345-192.168.206.51@tcp:38:mount.lustre.0 Request processed in 425us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518229.869660:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+6:2344:x1876445617037440:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518229.869669:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:2.0:1789518229.869697:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+6:2344:x1876445617037440:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 40us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518229.869704:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:0.0:1789518229.869717:0:15091:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789518229.869725:0:15091:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1789518229.870206:0:15092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+6:2345:x1876445617037696:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 772us (1290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518229.870215:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:3.0:1789518229.870243:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:3.0:1789518229.870251:0:15092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+5:2344:x1876445617037824:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518229.870277:0:15092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+5:2344:x1876445617037824:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 28us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518229.870283:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:2.0:1789518229.873072:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518229.873132:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518229.873188:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617037312 00000100:00100000:0.0:1789518229.873206:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617037312 00000100:00100000:0.0:1789518229.873265:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617037568 00000100:00100000:0.0:1789518229.873269:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617037568 00000100:00100000:3.0:1789518229.873288:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:3.0:1789518229.873303:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d429a188-2689-4f02-8a27-a318f1cbf37a+7:0:x1876445617037312:12345-192.168.206.51@tcp:41:mount.lustre.0 00000100:00100000:0.0:1789518229.873309:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:0.0:1789518229.873321:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d429a188-2689-4f02-8a27-a318f1cbf37a+7:13830:x1876445617037568:12345-192.168.206.51@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789518229.873346:0:15115:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000004:00000024:0.0:1789518229.873347:0:14410:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:1.0:1789518229.873424:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518229.873466:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d429a188-2689-4f02-8a27-a318f1cbf37a+7:0:x1876445617037312:12345-192.168.206.51@tcp:41:mount.lustre.0 Request processed in 167us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518229.873474:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:0.0:1789518229.874271:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d429a188-2689-4f02-8a27-a318f1cbf37a+6:13830:x1876445617037568:12345-192.168.206.51@tcp:41:mount.lustre.0 Request processed in 949us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518229.874280:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:1.0:1789518229.875815:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518229.876491:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617037952 00000100:00100000:2.0:1789518229.876501:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617037952 00000100:00100000:2.0:1789518229.876562:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:2.0:1789518229.876573:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d429a188-2689-4f02-8a27-a318f1cbf37a+6:13830:x1876445617037952:12345-192.168.206.51@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789518229.876669:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d429a188-2689-4f02-8a27-a318f1cbf37a+6:13830:x1876445617037952:12345-192.168.206.51@tcp:40:mount.lustre.0 Request processed in 97us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518229.876677:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:2.0:1789518229.880526:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518229.880574:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518229.880606:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518229.880668:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617038080 00000100:00100000:0.0:1789518229.880677:0:15093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617038080 00000100:00100000:0.0:1789518229.880713:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617038208 00000100:00100000:0.0:1789518229.880716:0:15093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617038208 00000100:00100000:0.0:1789518229.880735:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:0.0:1789518229.880742:0:15093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2341:x1876445617038080:12345-192.168.206.51@tcp:8:mount.lustre.0 00000100:00100000:1.0:1789518229.880759:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617038336 00000100:00100000:1.0:1789518229.880763:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617038336 00010000:00080000:0.0:1789518229.880771:0:15093:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from d429a188-2689-4f02-8a27-a318f1cbf37a@192.168.206.51@tcp t0 exp 0000000000000000 cur 283 last 0 00000100:00100000:1.0:1789518229.880792:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1 00000020:00000080:0.0:1789518229.880801:0:15093:0:(genops.c:1384:class_connect()) connect: client d429a188-2689-4f02-8a27-a318f1cbf37a, cookie 0x631fd8698c782059 00000100:00100000:1.0:1789518229.880807:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d429a188-2689-4f02-8a27-a318f1cbf37a+6:13830:x1876445617038336:12345-192.168.206.51@tcp:33:mount.lustre.0 00002000:00100000:0.0:1789518229.880811:0:15093:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d429a188-2689-4f02-8a27-a318f1cbf37a/ffff99fec35a2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789518229.880820:0:15093:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000004:00200000:1.0:1789518229.880872:0:14413:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00002000:00080000:0.0:1789518229.880915:0:15093:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:1.0:1789518229.880935:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d429a188-2689-4f02-8a27-a318f1cbf37a+6:13830:x1876445617038336:12345-192.168.206.51@tcp:33:mount.lustre.0 Request processed in 137us (419us total) trans 0 rc 0/0 00000100:00080000:0.0:1789518229.880940:0:15093:0:(import.c:65:import_set_state_nolock()) ffff99fec35a5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789518229.880942:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:0.0:1789518229.880965:0:15093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d429a188-2689-4f02-8a27-a318f1cbf37a+6:2341:x1876445617038080:12345-192.168.206.51@tcp:8:mount.lustre.0 Request processed in 223us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518229.880971:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:0.0:1789518229.880983:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:0.0:1789518229.881279:0:15093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2341:x1876445617038208:12345-192.168.206.51@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789518229.881295:0:15093:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from d429a188-2689-4f02-8a27-a318f1cbf37a@192.168.206.51@tcp t0 exp 0000000000000000 cur 283 last 0 00000020:00000080:0.0:1789518229.881310:0:15093:0:(genops.c:1384:class_connect()) connect: client d429a188-2689-4f02-8a27-a318f1cbf37a, cookie 0x631fd8698c782060 00002000:00100000:0.0:1789518229.881322:0:15093:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d429a188-2689-4f02-8a27-a318f1cbf37a/ffff99fec35a0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789518229.881328:0:15093:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789518229.881381:0:15093:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789518229.881396:0:15093:0:(import.c:65:import_set_state_nolock()) ffff99fec35a6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789518229.881425:0:15093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d429a188-2689-4f02-8a27-a318f1cbf37a+6:2341:x1876445617038208:12345-192.168.206.51@tcp:8:mount.lustre.0 Request processed in 146us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518229.883369:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:2.0:1789518229.985777:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518229.985864:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617038464 00000100:00100000:3.0:1789518229.985874:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617038464 00000100:00100000:3.0:1789518229.985936:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:3.0:1789518229.985945:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d429a188-2689-4f02-8a27-a318f1cbf37a+6:13861:x1876445617038464:12345-192.168.206.51@tcp:101:mkdir.0 00010000:00010000:3.0:1789518229.985964:0:15115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518229.985986:0:15115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c782067 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcb96 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518229.986048:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c78206e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518229.986071:0:15115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c78206e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518229.986082:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c78206e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518229.986115:0:15115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789518229.986119:0:15115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518229.986140:0:15115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c78206e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518229.986165:0:15115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c782067 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcb96 expref: 8 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518229.986182:0:15115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c78206e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcb96 expref: 7 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518229.986190:0:15115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffd2a17100) 00010000:00010000:3.0:1789518229.986193:0:15115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789518229.986197:0:15115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6000, rc 0) 00000100:00100000:3.0:1789518229.986313:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d429a188-2689-4f02-8a27-a318f1cbf37a+7:13861:x1876445617038464:12345-192.168.206.51@tcp:101:mkdir.0 Request processed in 369us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518229.986320:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00010000:00010000:1.0:1789518230.258827:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789518230.451061:0:14443:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789518230.451075:0:14443:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518230.451786:0:14443:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1789518230.451888:0:14443:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518230.451929:0:14443:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00000001:00100000:0.0:1789518231.196509:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d429a188-2689-4f02-8a27-a318f1cbf37a 00000001:00100000:0.0:1789518231.196529:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aa777a5b-38aa-4d6a-adfe-237c479e59ff 00010000:00010000:2.0:1789518231.283731:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789518231.641388:0:16367:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789518232.306830:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518233.331721:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789518233.579150:0:16514:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff0e747090 20000000:00000080:2.0:1789518233.579165:0:16514:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99fec354b400 uarg=0000000000000000 20000000:01000000:2.0:1789518233.579197:0:16514:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789518233.579202:0:16514:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789518233.579206:0:16514:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789518233.580579:0:16515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1789518233.581366:0:16514:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789518233.588660:0:16514:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789518233.588690:0:16514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ffed5bc600/0x631fd8698c782075 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518233.588709:0:16514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99fffc2f7000/0x631fd8698c781d6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c781d65 expref: 18 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518233.588719:0:16514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99fffc2f6a00/0x631fd8698c781db9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c781db2 expref: 18 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518233.588726:0:16514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99fffc2f6600/0x631fd8698c781ef4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c781eed expref: 18 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518233.588754:0:16514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99fffc2f7800/0x631fd8698c781f4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcb0a expref: 12 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518233.588761:0:16514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffc29c9200/0x631fd8698c78204b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcb6c expref: 12 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518233.588769:0:16514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ffed5bc600/0x631fd8698c782075 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518233.588811:0:16514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffc29c9200/0x631fd8698c78204b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcb6c expref: 12 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518233.588827:0:16514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ffc29c9200/0x631fd8698c78204b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcb6c expref: 12 pid: 14404 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518233.588841:0:16514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16514:1876445627501184:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518233.588948:0:16514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99fffc2f7800/0x631fd8698c781f4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcb0a expref: 12 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518233.588958:0:16514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99fffc2f7800/0x631fd8698c781f4f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcb0a expref: 12 pid: 14405 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518233.588967:0:16514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16514:1876445627501312:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518233.589003:0:16514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99fffc2f6600/0x631fd8698c781ef4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c781eed expref: 18 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518233.589011:0:16514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99fffc2f6600/0x631fd8698c781ef4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c781eed expref: 18 pid: 14404 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518233.589033:0:16514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16514:1876445627501440:0@lo:104: 00000100:00100000:0.0:1789518233.589087:0:16514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789518233.589125:0:16514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99fffc2f6a00/0x631fd8698c781db9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c781db2 expref: 18 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518233.589134:0:16514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99fffc2f6a00/0x631fd8698c781db9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c781db2 expref: 18 pid: 14403 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518233.589143:0:16514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16514:1876445627501568:0@lo:104: 00000100:00100000:0.0:1789518233.589164:0:16514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789518233.589199:0:16514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99fffc2f7000/0x631fd8698c781d6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c781d65 expref: 18 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518233.589206:0:16514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99fffc2f7000/0x631fd8698c781d6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c781d65 expref: 18 pid: 14404 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518233.589213:0:16514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28adc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16514:1876445627501696:0@lo:104: 00000100:00100000:0.0:1789518233.589231:0:16514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518233.589238:0:16514:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc516cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789518233.589307:0:14393:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789518233.589321:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627501440 00000100:00100000:3.0:1789518233.589328:0:14393:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627501440 00000100:00100000:2.0:1789518233.589445:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627501568 00000100:00100000:2.0:1789518233.589450:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627501568 00000100:00100000:2.0:1789518233.589473:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627501696 00000100:00100000:2.0:1789518233.589475:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627501696 00000100:00100000:2.0:1789518233.589486:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789518233.589492:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+5:16514:x1876445627501568:12345-0@lo:104: 00010000:00010000:2.0:1789518233.589502:0:14394:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffed5bce00/0x631fd8698c781db2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c781db9 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518233.589676:0:16514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16514:1876445627501568:0@lo:104: 00010000:00010000:2.0:1789518233.589940:0:14394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789518233.589947:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+5:16514:x1876445627501568:12345-0@lo:104: Request processed in 454us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518233.589954:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789518233.589973:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789518233.589980:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffb96450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+4:16514:x1876445627501696:12345-0@lo:104: 00010000:00010000:2.0:1789518233.589988:0:14394:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc800/0x631fd8698c781d65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c781d6c expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518233.590084:0:16514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28adc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16514:1876445627501696:0@lo:104: 00010000:00010000:1.0:1789518233.590150:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789518233.590157:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffed5bce00/0x631fd8698c781db2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c781db9 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518233.590165:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bce00 already unused, calling callback (ffffffffc1b17c20) 00010000:00010000:2.0:1789518233.590168:0:14394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789518233.590174:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffb96450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+4:16514:x1876445627501696:12345-0@lo:104: Request processed in 196us (941us total) trans 0 rc 0/0 10000000:00010000:1.0:1789518233.590175:0:14399:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bce00/0x631fd8698c781db2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c781db9 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518233.590184:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1789518233.590184:0:14399:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffed5bce00/0x631fd8698c781db2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c781db9 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518233.590190:0:14399:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bce00/0x631fd8698c781db2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c781db9 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518233.590196:0:14399:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1789518233.590197:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789518233.590203:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+3:16514:x1876445627501440:12345-0@lo:104: 00010000:00010000:2.0:1789518233.590211:0:14394:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7400/0x631fd8698c781eed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c781ef4 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518233.590233:0:14399:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffed5bce00/0x631fd8698c781db2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c781db9 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518233.590240:0:14399:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789518233.590242:0:14394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789518233.590246:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+3:16514:x1876445627501440:12345-0@lo:104: Request processed in 44us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518233.590252:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1789518233.590257:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789518233.590264:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bce00/0x631fd8698c781db2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c781db9 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518233.590273:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffed5bce00/0x631fd8698c781db2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c781db9 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518233.590283:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789518233.590285:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4003480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a262dbd-f283-43e3-b7fd-ac44d37658cb:3283:1876445627501824:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789518233.590287:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7400/0x631fd8698c781eed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c781ef4 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518233.590297:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7400 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:1.0:1789518233.590301:0:14399:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7400/0x631fd8698c781eed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c781ef4 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518233.590308:0:14399:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7400/0x631fd8698c781eed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c781ef4 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518233.590340:0:14399:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7400/0x631fd8698c781eed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c781ef4 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518233.590345:0:14399:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789518233.590358:0:14399:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7400/0x631fd8698c781eed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c781ef4 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518233.590364:0:14399:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789518233.590381:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7400/0x631fd8698c781eed lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c781ef4 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518233.590388:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99fffc2f7400/0x631fd8698c781eed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c781ef4 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518233.590398:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518233.590399:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518233.590401:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518233.590412:0:16516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518233.590413:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4003800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a262dbd-f283-43e3-b7fd-ac44d37658cb:3280:1876445627501952:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789518233.590417:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc800/0x631fd8698c781d65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c781d6c expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518233.590421:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789518233.590429:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc800 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:2.0:1789518233.590432:0:14398:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc800/0x631fd8698c781d65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c781d6c expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518233.590440:0:14398:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc800/0x631fd8698c781d65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c781d6c expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518233.590447:0:14398:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc800/0x631fd8698c781d65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c781d6c expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518233.590447:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1789518233.590452:0:14398:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789518233.590468:0:14398:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc800/0x631fd8698c781d65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c781d6c expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518233.590474:0:14398:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789518233.590493:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627501824 00000100:00100000:3.0:1789518233.590497:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627501824 00000100:00100000:1.0:1789518233.590505:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a262dbd-f283-43e3-b7fd-ac44d37658cb:3281:1876445627502080:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789518233.590514:0:14396:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99fffc2f6a00/0x631fd8698c781db9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c781db2 expref: 19 pid: 14403 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518233.590550:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627501952 00000100:00100000:0.0:1789518233.590555:0:16514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16514:1876445627501440:0@lo:104: 00000100:00100000:3.0:1789518233.590556:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627501952 00000100:00100000:1.0:1789518233.590560:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789518233.590574:0:14396:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99fffc2f6600/0x631fd8698c781ef4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c781eed expref: 20 pid: 14404 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518233.590591:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627502080 00000100:00100000:3.0:1789518233.590594:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627502080 00000100:00100000:0.0:1789518233.590604:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1789518233.590607:0:14396:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99fffc2f7000/0x631fd8698c781d6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c781d65 expref: 21 pid: 14404 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518233.590637:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+21:3283:x1876445627501824:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518233.590647:0:14396:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:0.0:1789518233.590650:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789518233.590656:0:14396:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1789518233.590658:0:14397:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99fffc2f6a00/0x631fd8698c781db9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c781db2 expref: 21 pid: 14403 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518233.590676:0:14397:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99fffc2f6a00/0x631fd8698c781db9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c781db2 expref: 21 pid: 14403 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518233.590688:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc2f6a00/0x631fd8698c781db9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c781db2 expref: 21 pid: 14403 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518233.590699:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518233.590732:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+20:3283:x1876445627501824:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518233.590739:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789518233.590757:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789518233.590763:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4002300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+19:3280:x1876445627501952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789518233.590770:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518233.590774:0:14397:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99fffc2f6600/0x631fd8698c781ef4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c781eed expref: 19 pid: 14404 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518233.590781:0:14397:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99fffc2f6600/0x631fd8698c781ef4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c781eed expref: 19 pid: 14404 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518233.590792:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc2f6600/0x631fd8698c781ef4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c781eed expref: 19 pid: 14404 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518233.590801:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518233.590824:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4003480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a262dbd-f283-43e3-b7fd-ac44d37658cb:3283:1876445627501824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518233.590836:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4002300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+18:3280:x1876445627501952:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518233.590848:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789518233.590855:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789518233.590862:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc33c5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+17:3281:x1876445627502080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789518233.590868:0:14396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518233.590872:0:14396:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99fffc2f7000/0x631fd8698c781d6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c781d65 expref: 17 pid: 14404 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518233.590879:0:14396:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99fffc2f7000/0x631fd8698c781d6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c781d65 expref: 17 pid: 14404 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518233.590888:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc2f7000/0x631fd8698c781d6c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c781d65 expref: 17 pid: 14404 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518233.590895:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4003800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a262dbd-f283-43e3-b7fd-ac44d37658cb:3280:1876445627501952:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789518233.590912:0:14396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518233.590926:0:16516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518233.590935:0:16516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518233.590999:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc33c5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+16:3281:x1876445627502080:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518233.591007:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789518233.591018:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a262dbd-f283-43e3-b7fd-ac44d37658cb:3281:1876445627502080:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789518233.591035:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc800/0x631fd8698c781d65 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c781d6c expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518233.591054:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc800/0x631fd8698c781d65 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c781d6c expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518233.591068:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518233.591071:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518233.591073:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518233.592678:0:16514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16514:1876445627501184:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518233.592691:0:16514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16514:1876445627501312:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518233.592722:0:16514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ffed5bc600/0x631fd8698c782075 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518233.592951:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518233.593008:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617038592 00000100:00100000:0.0:1789518233.593012:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617038592 00010000:00010000:0.0:1789518233.593033:0:14397:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffc29c9200/0x631fd8698c78204b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcb6c expref: 13 pid: 14404 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518233.593125:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:0.0:1789518233.593132:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4000380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17615ede-c250-4a03-8ccd-330fab022941+13:2344:x1876445617038592:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518233.593142:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518233.593145:0:14397:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffc29c9200/0x631fd8698c78204b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcb6c expref: 13 pid: 14404 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518233.593152:0:14397:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffc29c9200/0x631fd8698c78204b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcb6c expref: 13 pid: 14404 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518233.593163:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc29c9200/0x631fd8698c78204b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcb6c expref: 13 pid: 14404 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518233.593176:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518233.593214:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4000380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17615ede-c250-4a03-8ccd-330fab022941+12:2344:x1876445617038592:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 83us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518233.593218:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:2.0:1789518233.593967:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518233.594009:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617038720 00000100:00100000:3.0:1789518233.594016:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617038720 00010000:00010000:3.0:1789518233.594043:0:14396:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99fffc2f7800/0x631fd8698c781f4f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcb0a expref: 12 pid: 14405 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518233.594089:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:3.0:1789518233.594200:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17615ede-c250-4a03-8ccd-330fab022941+12:2343:x1876445617038720:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518233.594279:0:14396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518233.594285:0:14396:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99fffc2f7800/0x631fd8698c781f4f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcb0a expref: 12 pid: 14405 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518233.594297:0:14396:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99fffc2f7800/0x631fd8698c781f4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcb0a expref: 12 pid: 14405 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518233.594311:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc2f7800/0x631fd8698c781f4f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcb0a expref: 12 pid: 14405 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518233.594324:0:14396:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ffed5bc600/0x631fd8698c782075 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518233.594331:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bc600/0x631fd8698c782075 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518233.594346:0:14396:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffed5bc600/0x631fd8698c782075 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518233.594365:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffed5bc600/0x631fd8698c782075 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518233.594372:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ffed5bc600/0x631fd8698c782075 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518233.594379:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ffed5bc600/0x631fd8698c782075 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518233.594385:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518233.594389:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ffed5bc600/0x631fd8698c782075 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518233.594396:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ffed5bc600/0x631fd8698c782075 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518233.594414:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ffed5bc600/0x631fd8698c782075 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518233.594425:0:14396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518233.594484:0:16514:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ffed5bc600/0x631fd8698c782075 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518233.594499:0:16514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ffed5bc600/0x631fd8698c782075 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518233.594504:0:16514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffed5bc600/0x631fd8698c782075 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518233.594516:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17615ede-c250-4a03-8ccd-330fab022941+11:2343:x1876445617038720:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 417us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518233.594539:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:3.0:1789518233.715689:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627502208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518233.715762:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518233.717163:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789518233.717174:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4001f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627502336:0@lo:400:kworker.0 00000100:00100000:3.0:1789518233.717248:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518233.717327:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4003b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627502592:0@lo:400:kworker.0 00000100:00100000:1.0:1789518233.717369:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518233.717421:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627502592 00000100:00100000:1.0:1789518233.717436:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627502592 00000100:00100000:3.0:1789518233.717474:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4001180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627502720:0@lo:400:kworker.0 00000100:00100000:1.0:1789518233.717503:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789518233.717508:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518233.717537:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627502720 00000100:00100000:2.0:1789518233.717543:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627502720 00000100:00100000:3.0:1789518233.717569:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627502208 00000100:00100000:3.0:1789518233.717575:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627502208 00000100:00100000:3.0:1789518233.717610:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789518233.717641:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1876445627502208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789518233.717670:0:15095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789518233.717682:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789518233.717690:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876445627502720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518233.717719:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1876445627502208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (1967us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518233.717728:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789518233.717736:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876445627502720:12345-0@lo:400:kworker.0 Request processed in 46us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518233.717744:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1789518233.717774:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518233.717775:0:16281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627502336 00000100:00100000:3.0:1789518233.717780:0:16281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627502336 00000100:00080000:1.0:1789518233.717782:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518233.717788:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4002d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627502464:0@lo:400:kworker.0 00000100:00100000:1.0:1789518233.717799:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4000a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627502592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518233.717813:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518233.717835:0:16281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789518233.717843:0:16281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627502336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518233.717881:0:16281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627502336:12345-0@lo:400:kworker.0 Request processed in 39us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518233.717887:0:16281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789518233.717913:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627502464 00000100:00100000:3.0:1789518233.717917:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627502464 00000100:00100000:1.0:1789518233.717931:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4000a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627502592:12345-0@lo:400:kworker.0 Request processed in 416us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518233.717937:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789518233.717944:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789518233.717961:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627502464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518233.717998:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627502464:12345-0@lo:400:kworker.0 Request processed in 53us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518233.718005:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1789518233.718026:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518233.718056:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4003b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627502592:0@lo:400:kworker.0 00000100:00100000:3.0:1789518233.718123:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4001180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627502720:0@lo:400:kworker.0 00000100:00100000:3.0:1789518233.718136:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4001f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627502336:0@lo:400:kworker.0 00000100:00100000:3.0:1789518233.718164:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627502208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518233.718329:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4002d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627502464:0@lo:400:kworker.0 00000001:00100000:0.0:1789518233.746539:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d429a188-2689-4f02-8a27-a318f1cbf37a 00000001:00100000:1.0:1789518233.760465:0:7607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d429a188-2689-4f02-8a27-a318f1cbf37a 00000001:00100000:1.0:1789518233.760482:0:7607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1789518233.760490:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00100000:2.0:1789518234.227336:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518234.227357:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627502848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518234.227418:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518234.227466:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627502848 00000100:00100000:0.0:1789518234.227474:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627502848 00000100:00100000:0.0:1789518234.227530:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789518234.227604:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627502848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518234.227656:0:15095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789518234.227708:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627502848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 170us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518234.227726:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789518234.228126:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627502848:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789518234.355959:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789518234.738695:0:14407:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789518234.738703:0:14407:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ffedb7a000 from 10 10000000:01000000:0.0:1789518234.738718:0:14407:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789518234.738760:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc600/0x631fd8698c78207c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518234.738771:0:14407:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc600/0x631fd8698c78207c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518234.738782:0:14407:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc600/0x631fd8698c78207c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518234.738820:0:14407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28adf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14407:1876445627502976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789518234.738883:0:14407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518234.738928:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627502976 00000100:00100000:1.0:1789518234.738935:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627502976 00000100:00100000:0.0:1789518234.738945:0:14407:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a2cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789518234.740368:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789518234.740382:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff72f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+16:14407:x1876445627502976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518234.740397:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518234.740413:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc2f6000/0x631fd8698c782083 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c78207c expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518234.740435:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc2f6000/0x631fd8698c782083 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c78207c expref: 17 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518234.740445:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc2f6000/0x631fd8698c782083 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c78207c expref: 17 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518234.740454:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f6000, rc 0) 00000100:00100000:1.0:1789518234.740530:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff72f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+17:14407:x1876445627502976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (1647us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518234.740537:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789518234.740660:0:14407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28adf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14407:1876445627502976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518234.740678:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc600/0x631fd8698c78207c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c782083 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518234.740687:0:14407:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc600/0x631fd8698c78207c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c782083 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518234.740746:0:14407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28adf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14407:1876445627503104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518234.740775:0:14407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518234.740808:0:14407:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a2cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789518234.740922:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627503104 00000100:00100000:3.0:1789518234.740929:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627503104 00000100:00100000:3.0:1789518234.740970:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789518234.740978:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff72f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+17:14407:x1876445627503104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518234.741425:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff72f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+17:14407:x1876445627503104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 447us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518234.741433:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789518234.742402:0:14407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28adf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14407:1876445627503104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518234.742441:0:14407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28adf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14407:1876445627503232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518234.742485:0:14407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518234.742527:0:14407:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a2cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789518234.742587:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627503232 00000100:00100000:2.0:1789518234.742593:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627503232 00000100:00100000:2.0:1789518234.742730:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789518234.742740:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff72c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+17:14407:x1876445627503232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789518234.742931:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff72c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+17:14407:x1876445627503232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 193us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518234.742945:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789518234.743054:0:14407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28adf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14407:1876445627503232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789518234.745287:0:16605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789518234.747310:0:14407:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789518234.747339:0:14407:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789518234.747349:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc600/0x631fd8698c78207c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c782083 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518234.747362:0:14407:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc600/0x631fd8698c78207c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c782083 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518234.747384:0:14407:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789518234.747386:0:14407:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ffedb71000 from 10 10000000:01000000:0.0:1789518234.747389:0:14407:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789518234.747420:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc800/0x631fd8698c78208a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518234.747427:0:14407:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc800/0x631fd8698c78208a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518234.747437:0:14407:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc800/0x631fd8698c78208a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518234.747458:0:14407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14407:1876445627503360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789518234.747526:0:14407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518234.747565:0:14407:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbe0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518234.747660:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627503360 00000100:00100000:2.0:1789518234.747667:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627503360 00000100:00100000:2.0:1789518234.747705:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789518234.747714:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff72d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+17:14407:x1876445627503360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789518234.747726:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518234.747737:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc29c9000/0x631fd8698c782091 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c78208a expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518234.747759:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc29c9000/0x631fd8698c782091 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c78208a expref: 18 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518234.747768:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc29c9000/0x631fd8698c782091 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c78208a expref: 18 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518234.747777:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29c9000, rc 0) 00000100:00100000:2.0:1789518234.747819:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff72d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+18:14407:x1876445627503360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518234.747826:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789518234.749073:0:14407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14407:1876445627503360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518234.749093:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc800/0x631fd8698c78208a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c782091 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518234.749104:0:14407:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc800/0x631fd8698c78208a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c782091 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518234.749167:0:14407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14407:1876445627503488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518234.750312:0:14407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518234.750353:0:14407:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbe0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518234.750456:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627503488 00000100:00100000:2.0:1789518234.750462:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627503488 00000100:00100000:2.0:1789518234.750523:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789518234.750533:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff72cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+18:14407:x1876445627503488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789518234.750786:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff72cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+18:14407:x1876445627503488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 254us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518234.750794:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789518234.750952:0:14407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14407:1876445627503488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518234.750991:0:14407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14407:1876445627503616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518234.751035:0:14407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518234.751905:0:14407:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbe0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518234.752725:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627503616 00000100:00100000:1.0:1789518234.752734:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627503616 00000100:00100000:1.0:1789518234.752796:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789518234.752806:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff72c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+18:14407:x1876445627503616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518234.753018:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff72c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+18:14407:x1876445627503616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 213us (1982us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518234.753025:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789518234.753191:0:14407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14407:1876445627503616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789518234.754872:0:16607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789518234.755014:0:14407:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789518234.755035:0:14407:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789518234.755044:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc800/0x631fd8698c78208a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c782091 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518234.755056:0:14407:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc800/0x631fd8698c78208a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c782091 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518234.755066:0:14407:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789518234.755068:0:14407:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ffd8b25000 from 10 10000000:01000000:0.0:1789518234.755070:0:14407:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789518234.755100:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bce00/0x631fd8698c782098 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518234.755107:0:14407:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffed5bce00/0x631fd8698c782098 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518234.755179:0:14407:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffed5bce00/0x631fd8698c782098 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518234.755203:0:14407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14407:1876445627503744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789518234.755268:0:14407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518234.755424:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627503744 00000100:00100000:1.0:1789518234.755430:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627503744 00000100:00100000:1.0:1789518234.755469:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789518234.755479:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff72d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+18:14407:x1876445627503744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518234.755495:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1789518234.755499:0:14407:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbe0c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789518234.755508:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc2f7800/0x631fd8698c78209f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c782098 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518234.755543:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc2f7800/0x631fd8698c78209f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c782098 expref: 19 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518234.755557:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc2f7800/0x631fd8698c78209f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c782098 expref: 19 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518234.755565:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f7800, rc 0) 00000100:00100000:1.0:1789518234.755625:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff72d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+19:14407:x1876445627503744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518234.755630:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789518234.755752:0:14407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14407:1876445627503744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518234.755765:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffed5bce00/0x631fd8698c782098 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78209f expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518234.755781:0:14407:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bce00/0x631fd8698c782098 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c78209f expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518234.755948:0:14407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14407:1876445627503872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518234.755974:0:14407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518234.756001:0:14407:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbe0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518234.756026:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627503872 00000100:00100000:1.0:1789518234.756031:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627503872 00000100:00100000:1.0:1789518234.756061:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789518234.756066:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff72ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+19:14407:x1876445627503872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518234.756580:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff72ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a262dbd-f283-43e3-b7fd-ac44d37658cb+19:14407:x1876445627503872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 511us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518234.756588:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789518234.756631:0:14407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14407:1876445627503872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518234.756676:0:14407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14407:1876445627504000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518234.756716:0:14407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518234.756742:0:14407:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbe0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518234.756749:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627504000 00000100:00100000:1.0:1789518234.756753:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627504000 00000100:00100000:1.0:1789518234.756889:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789518234.756898:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+19:14407:x1876445627504000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518234.757026:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a262dbd-f283-43e3-b7fd-ac44d37658cb+19:14407:x1876445627504000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518234.757034:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789518234.757048:0:14407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a262dbd-f283-43e3-b7fd-ac44d37658cb:14407:1876445627504000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789518234.759695:0:16609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789518234.760788:0:14407:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789518234.760818:0:14407:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789518234.760829:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bce00/0x631fd8698c782098 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78209f expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518234.760841:0:14407:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffed5bce00/0x631fd8698c782098 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78209f expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518235.021590:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518235.021656:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518235.021686:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518235.021720:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617039104 00000100:00100000:3.0:1789518235.021723:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518235.021732:0:15093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617039104 00000100:00100000:3.0:1789518235.021742:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518235.021766:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518235.021793:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617039616 00000100:00100000:3.0:1789518235.021795:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518235.021798:0:15093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617039616 00000100:00100000:3.0:1789518235.021816:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617039360 00000100:00100000:0.0:1789518235.021818:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617039232 00000100:00100000:3.0:1789518235.021822:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617039360 00000100:00100000:0.0:1789518235.021823:0:15093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617039232 00000100:00100000:0.0:1789518235.021846:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617039488 00000100:00100000:0.0:1789518235.021850:0:15093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617039488 00000100:00100000:3.0:1789518235.021864:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617038976 00000100:00100000:3.0:1789518235.021869:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617038976 00000100:00100000:0.0:1789518235.021875:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:0.0:1789518235.021887:0:15093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa777a5b-38aa-4d6a-adfe-237c479e59ff+5:2344:x1876445617039104:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518235.021896:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:3.0:1789518235.021906:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d429a188-2689-4f02-8a27-a318f1cbf37a+6:2344:x1876445617039360:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518235.021963:0:15093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa777a5b-38aa-4d6a-adfe-237c479e59ff+5:2344:x1876445617039104:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 78us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518235.021972:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:0.0:1789518235.021990:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:2.0:1789518235.022001:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:2.0:1789518235.022020:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+6:2344:x1876445617038976:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518235.022021:0:15093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d429a188-2689-4f02-8a27-a318f1cbf37a+5:2344:x1876445617039616:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518235.022036:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617038848 00000100:00100000:1.0:1789518235.022042:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617038848 00000100:00100000:1.0:1789518235.022074:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 108 00000100:00100000:1.0:1789518235.022081:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17615ede-c250-4a03-8ccd-330fab022941+11:2344:x1876445617038848:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518235.023011:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+6:2344:x1876445617038976:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 994us (1263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518235.023020:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:3.0:1789518235.023132:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d429a188-2689-4f02-8a27-a318f1cbf37a+6:2344:x1876445617039360:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 1227us (1444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518235.023140:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:3.0:1789518235.023175:0:16281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:3.0:1789518235.023184:0:16281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa777a5b-38aa-4d6a-adfe-237c479e59ff+5:2344:x1876445617039232:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518235.023217:0:16281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa777a5b-38aa-4d6a-adfe-237c479e59ff+5:2344:x1876445617039232:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 34us (1450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518235.023223:0:16281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:3.0:1789518235.023237:0:16281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:3.0:1789518235.023244:0:16281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d429a188-2689-4f02-8a27-a318f1cbf37a+5:2344:x1876445617039488:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518235.023268:0:16281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d429a188-2689-4f02-8a27-a318f1cbf37a+5:2344:x1876445617039488:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 25us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518235.023273:0:16281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00080000:3.0:1789518235.023323:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789518235.023328:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789518235.023330:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518235.024431:0:15093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d429a188-2689-4f02-8a27-a318f1cbf37a+5:2344:x1876445617039616:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 2413us (2703us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518235.024441:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:1.0:1789518235.025885:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17615ede-c250-4a03-8ccd-330fab022941+11:2344:x1876445617038848:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 3797us (4296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518235.025899:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 108 00010000:00010000:0.0:1789518235.379426:0:16516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518235.597570:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518235.597772:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617039744 00000100:00100000:1.0:1789518235.597782:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617039744 00000100:00100000:1.0:1789518235.597837:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 109 00000100:00100000:1.0:1789518235.597846:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17615ede-c250-4a03-8ccd-330fab022941+11:13716:x1876445617039744:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518235.597875:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518235.597892:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc2f7000/0x631fd8698c7820a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcb9d expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.597920:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc2f7000/0x631fd8698c7820a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcb9d expref: 12 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.597930:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc2f7000/0x631fd8698c7820a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcb9d expref: 12 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.597938:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f7000, rc 0) 00000100:00100000:1.0:1789518235.598046:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17615ede-c250-4a03-8ccd-330fab022941+12:13716:x1876445617039744:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 200us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518235.598053:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 109 00000100:00100000:3.0:1789518235.604827:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518235.604910:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617039872 00000100:00100000:1.0:1789518235.604921:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617039872 00000100:00100000:1.0:1789518235.604974:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 110 00000100:00100000:1.0:1789518235.604984:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17615ede-c250-4a03-8ccd-330fab022941+12:13716:x1876445617039872:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518235.605246:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17615ede-c250-4a03-8ccd-330fab022941+12:13716:x1876445617039872:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 262us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518235.605253:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 110 00000100:00100000:2.0:1789518235.606977:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518235.607321:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617040000 00000100:00100000:1.0:1789518235.607330:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617040000 00000100:00100000:1.0:1789518235.607377:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 111 00000100:00100000:1.0:1789518235.607386:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17615ede-c250-4a03-8ccd-330fab022941+12:13716:x1876445617040000:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518235.607598:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17615ede-c250-4a03-8ccd-330fab022941+12:13716:x1876445617040000:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 205us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518235.607718:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 111 00000100:00100000:2.0:1789518235.617541:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518235.617648:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617040128 00000100:00100000:1.0:1789518235.617658:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617040128 00000100:00100000:1.0:1789518235.617743:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 112 00000100:00100000:1.0:1789518235.617752:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17615ede-c250-4a03-8ccd-330fab022941+12:13716:x1876445617040128:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518235.617767:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518235.617783:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc2f6600/0x631fd8698c7820ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcba4 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.617807:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc2f6600/0x631fd8698c7820ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcba4 expref: 13 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.617818:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc2f6600/0x631fd8698c7820ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcba4 expref: 13 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.617826:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f6600, rc 0) 00000100:00100000:1.0:1789518235.617880:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17615ede-c250-4a03-8ccd-330fab022941+13:13716:x1876445617040128:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 129us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518235.617887:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 112 00000100:00100000:3.0:1789518235.620449:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518235.620577:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617040256 00000100:00100000:1.0:1789518235.620586:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617040256 00000100:00100000:1.0:1789518235.620807:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 113 00000100:00100000:1.0:1789518235.620819:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17615ede-c250-4a03-8ccd-330fab022941+13:13716:x1876445617040256:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518235.621092:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17615ede-c250-4a03-8ccd-330fab022941+13:13716:x1876445617040256:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 274us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518235.621100:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 113 00000100:00100000:2.0:1789518235.624218:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518235.624310:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617040384 00000100:00100000:1.0:1789518235.624319:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617040384 00000100:00100000:1.0:1789518235.624368:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 114 00000100:00100000:1.0:1789518235.624379:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17615ede-c250-4a03-8ccd-330fab022941+13:13716:x1876445617040384:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518235.624590:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17615ede-c250-4a03-8ccd-330fab022941+13:13716:x1876445617040384:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 212us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518235.624598:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 114 00000100:00100000:2.0:1789518235.694097:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518235.694228:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617040512 00000100:00100000:1.0:1789518235.694237:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617040512 00000100:00100000:1.0:1789518235.694372:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:1.0:1789518235.694383:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+6:14371:x1876445617040512:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518235.694402:0:14409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518235.694424:0:14409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c7820b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcbab expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.694479:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c7820bb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.694659:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c7820bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.694747:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c7820bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.694826:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c7820c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.694834:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c7820c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.694867:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c7820c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.695139:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c7820c9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.695147:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c7820c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.695155:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c7820c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518235.695177:0:14409:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789518235.695180:0:14409:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518235.695213:0:14409:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c7820c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.695223:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c7820bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.695230:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c7820bb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.695236:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c7820bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.695241:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f6c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518235.695245:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c7820bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.695252:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c7820bb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.695412:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffd2a17100) 00010000:00010000:1.0:1789518235.695416:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518235.695421:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c7820bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.695427:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c7820bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.695438:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c7820c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.695445:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c7820c2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.695450:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c7820c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.695454:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518235.695457:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c7820c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.695462:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c7820c2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.695468:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff99ffc2fdc000) 00010000:00010000:1.0:1789518235.695470:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518235.695473:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c7820c2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.695478:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c7820c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.695738:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c7820b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbab expref: 8 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.695830:0:14409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c7820c9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbab expref: 7 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.695839:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99ffc2fdcf00) 00010000:00010000:1.0:1789518235.695841:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518235.695844:0:14409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f7600, rc 0) 00000100:00100000:1.0:1789518235.695920:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+7:14371:x1876445617040512:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1539us (1836us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518235.695928:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:3.0:1789518235.699683:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518235.701433:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617040768 00000100:00100000:0.0:1789518235.701446:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617040768 00000100:00100000:0.0:1789518235.701523:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:0.0:1789518235.701534:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+7:14371:x1876445617040768:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518235.701552:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518235.701570:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c7820d0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcbb2 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.701677:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7820d7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.701690:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7820d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.701700:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7820d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.701714:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c7820de lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.701720:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c7820de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.701725:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c7820de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.702015:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c7820e5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.702021:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c7820e5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.702026:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c7820e5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518235.702032:0:14410:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1789518235.702190:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7820d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.702208:0:14410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7820d7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.702215:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7820d7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.702220:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bca00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518235.702224:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7820d7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.702231:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7820d7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.702242:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99ffc2fdcf00) 00010000:00010000:0.0:1789518235.702245:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518235.702249:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7820d7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.702265:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7820d7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.702280:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c7820de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.702285:0:14410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c7820de lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.702290:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c7820de lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.702294:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518235.702297:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c7820de lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.702302:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c7820de lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.702309:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99ffd2a17400) 00010000:00010000:0.0:1789518235.702312:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518235.702314:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c7820de lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.702320:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c7820de lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.703072:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c7820d0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbb2 expref: 10 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.703114:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c7820e5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbb2 expref: 9 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.703122:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffd2a17500) 00010000:00010000:0.0:1789518235.703125:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518235.703128:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd000, rc 0) 00000100:00100000:0.0:1789518235.703198:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+9:14371:x1876445617040768:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1665us (3522us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789518235.703205:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:2.0:1789518235.706781:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518235.711401:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617040896 00000100:00100000:3.0:1789518235.711413:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617040896 00000100:00100000:3.0:1789518235.711534:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:3.0:1789518235.711544:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa777a5b-38aa-4d6a-adfe-237c479e59ff+9:14371:x1876445617040896:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789518235.711667:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa777a5b-38aa-4d6a-adfe-237c479e59ff+9:14371:x1876445617040896:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 Request processed in 124us (4894us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518235.711675:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:2.0:1789518235.746393:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518235.746534:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617041024 00000100:00100000:0.0:1789518235.746543:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617041024 00000100:00100000:0.0:1789518235.746647:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:0.0:1789518235.746658:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+9:14377:x1876445617041024:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518235.746675:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518235.746692:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c7820f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcbb9 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.746743:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c7820fa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.746754:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c7820fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.746763:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c7820fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.746774:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782101 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.746791:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782101 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.746797:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782101 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.746944:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c7820fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.746951:0:14410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c7820fa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.746956:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c7820fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.746960:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518235.746964:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c7820fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.746970:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c7820fa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.746981:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffd2a17100) 00010000:00010000:0.0:1789518235.746984:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518235.746988:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c7820fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.746994:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c7820fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.747008:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782101 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.747019:0:14410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782101 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.747024:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782101 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.747028:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bca00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518235.747031:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782101 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.747037:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782101 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.747044:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99ffd2a17400) 00010000:00010000:0.0:1789518235.747046:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518235.747049:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782101 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.747054:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782101 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.747877:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c7820f3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbb9 expref: 10 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.747889:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffd2a17100) 00010000:00010000:0.0:1789518235.747892:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518235.747895:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c7820f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbb9 expref: 10 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.747919:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc200, rc 0) 00000100:00100000:0.0:1789518235.748084:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+9:14377:x1876445617041024:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1427us (1695us total) trans 0 rc 301/301 00000100:00100000:0.0:1789518235.748092:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:0.0:1789518235.753864:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518235.753982:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617041152 00000100:00100000:1.0:1789518235.754003:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617041152 00000100:00100000:1.0:1789518235.754053:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:1.0:1789518235.754062:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+9:14377:x1876445617041152:12345-192.168.206.51@tcp:700:lfs.0 00000100:00100000:1.0:1789518235.754151:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+9:14377:x1876445617041152:12345-192.168.206.51@tcp:700:lfs.0 Request processed in 90us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518235.754158:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:1.0:1789518235.758503:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518235.759216:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617041408 00000100:00100000:2.0:1789518235.759225:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617041408 00000100:00100000:2.0:1789518235.759294:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:2.0:1789518235.759305:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4003100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+9:14377:x1876445617041408:12345-192.168.206.51@tcp:36:lfs.0 00010000:00010000:2.0:1789518235.759712:0:14409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518235.759741:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c781f72 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcb34 expref: 9 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.759781:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffd2a17100) 00010000:00010000:2.0:1789518235.759786:0:14409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518235.759964:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9400/0x631fd8698c782108 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.759978:0:14409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c78206e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcb96 expref: 5 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.759986:0:14409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9400/0x631fd8698c782108 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.760014:0:14409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c78206e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcb96 expref: 5 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.760027:0:14409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c78206e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcb96 expref: 5 pid: 15115 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518235.760784:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14409:1876445627504128:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518235.760886:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffdb5589c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518235.763799:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14409:1876445627504128:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518235.763827:0:14409:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9400/0x631fd8698c782108 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518235.768964:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518235.769588:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617041536 00000100:00100000:3.0:1789518235.769598:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617041536 00010000:00010000:3.0:1789518235.769667:0:14395:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c78206e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcb96 expref: 6 pid: 15115 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518235.769704:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:3.0:1789518235.769713:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4000000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d429a188-2689-4f02-8a27-a318f1cbf37a+6:2342:x1876445617041536:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518235.769727:0:14395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518235.769733:0:14395:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c78206e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcb96 expref: 6 pid: 15115 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.769746:0:14395:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c78206e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcb96 expref: 6 pid: 15115 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.769766:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c78206e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcb96 expref: 6 pid: 15115 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.769780:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffd2a17100) 00010000:00010000:3.0:1789518235.769785:0:14395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9400/0x631fd8698c782108 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.769897:0:14395:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9400/0x631fd8698c782108 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.769905:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9400/0x631fd8698c782108 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.769973:0:14395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518235.770023:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4000000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d429a188-2689-4f02-8a27-a318f1cbf37a+5:2342:x1876445617041536:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 311us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518235.770031:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00010000:00010000:1.0:1789518235.770601:0:14409:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9400/0x631fd8698c782108 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.770762:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9400/0x631fd8698c782108 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.770841:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c78210f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.770853:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c78210f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.770861:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c78210f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518235.772965:0:14409:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789518235.772979:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9400/0x631fd8698c782108 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.772988:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9400/0x631fd8698c782108 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.772995:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9400/0x631fd8698c782108 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.773001:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29c9400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518235.773004:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9400/0x631fd8698c782108 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.773012:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9400/0x631fd8698c782108 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.773025:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffd2a17100) 00010000:00010000:1.0:1789518235.773035:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518235.773040:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9400/0x631fd8698c782108 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.773046:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9400/0x631fd8698c782108 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789518235.773192:0:14409:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a930fa9 reply state 00000000420b0557 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c78210f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518235.773261:0:14409:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789518235.773425:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4003100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+10:14377:x1876445617041408:12345-192.168.206.51@tcp:36:lfs.0 Request processed in 14119us (14927us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789518235.773441:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 18 00010000:00010000:2.0:1789518235.774906:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c78210f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.774921:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c78210f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.774928:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c78210f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.774948:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518235.774953:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c78210f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.774961:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c78210f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.774973:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99ffc2fdc000) 00010000:00010000:2.0:1789518235.774976:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518235.774980:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c78210f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.774986:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c78210f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518235.829930:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518235.830489:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617041664 00000100:00100000:3.0:1789518235.830518:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617041664 00000100:00100000:3.0:1789518235.830651:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:3.0:1789518235.830662:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa777a5b-38aa-4d6a-adfe-237c479e59ff+9:14385:x1876445617041664:12345-192.168.206.51@tcp:101:lctl.0 00010000:00010000:3.0:1789518235.830683:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518235.830703:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c782116 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcbc0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.830760:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78211d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.830774:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78211d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.830786:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78211d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518235.830816:0:14411:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789518235.830826:0:14411:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518235.830980:0:14411:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78211d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.831006:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c782116 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbc0 expref: 11 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.831023:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78211d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbc0 expref: 10 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.831032:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffe6f98900) 00010000:00010000:3.0:1789518235.831035:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789518235.831038:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6c00, rc 0) 00000100:00100000:3.0:1789518235.831099:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa777a5b-38aa-4d6a-adfe-237c479e59ff+10:14385:x1876445617041664:12345-192.168.206.51@tcp:101:lctl.0 Request processed in 438us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518235.831106:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:1.0:1789518235.859163:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518235.859530:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617041792 00000100:00100000:3.0:1789518235.859539:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617041792 00000100:00100000:3.0:1789518235.859595:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:3.0:1789518235.859606:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4002a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d429a188-2689-4f02-8a27-a318f1cbf37a+5:14386:x1876445617041792:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518235.859663:0:15115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518235.859682:0:15115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c782124 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcbc7 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.859740:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c78212b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.860005:0:15115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c78212b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.860030:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c78212b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518235.860278:0:15115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789518235.860283:0:15115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518235.860553:0:15115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c78212b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.860579:0:15115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c782124 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbc7 expref: 7 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.860598:0:15115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c78212b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbc7 expref: 6 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.860606:0:15115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffe6f98900) 00010000:00010000:2.0:1789518235.860608:0:15115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518235.860647:0:15115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c7000, rc 0) 00000100:00100000:2.0:1789518235.860707:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4002a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d429a188-2689-4f02-8a27-a318f1cbf37a+6:14386:x1876445617041792:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1103us (1552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518235.860730:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:2.0:1789518235.868970:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518235.869047:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617041920 00000100:00100000:0.0:1789518235.869057:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617041920 00000100:00100000:0.0:1789518235.869111:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:0.0:1789518235.869120:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d429a188-2689-4f02-8a27-a318f1cbf37a+6:14386:x1876445617041920:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518235.869138:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518235.869157:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c782132 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcbce expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.869216:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782139 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.869229:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782139 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.869297:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782139 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.869314:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c782140 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.869322:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c782140 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.869346:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c782140 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.869425:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c782147 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.869434:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c782147 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.869440:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c782147 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518235.869469:0:14410:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789518235.869473:0:14410:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518235.869493:0:14410:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c782147 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.869504:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782139 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.872760:0:14410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782139 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.872771:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782139 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.872777:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bca00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518235.872782:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782139 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.872791:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782139 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.872884:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffe6f98900) 00010000:00010000:0.0:1789518235.872887:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518235.872892:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782139 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.872899:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782139 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.872922:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c782140 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.872928:0:14410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c782140 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.872934:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c782140 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.872938:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518235.872941:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c782140 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.872947:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c782140 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.872954:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99ffd2a17400) 00010000:00010000:0.0:1789518235.872957:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518235.872960:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c782140 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.872966:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c782140 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.873023:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c782132 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbce expref: 8 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.873039:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c782147 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbce expref: 7 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.873046:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99ffd2a17600) 00010000:00010000:0.0:1789518235.873048:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789518235.873051:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc200, rc 0) 00000100:00100000:0.0:1789518235.873199:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d429a188-2689-4f02-8a27-a318f1cbf37a+7:14386:x1876445617041920:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 4079us (4235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518235.873208:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:3.0:1789518235.879863:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518235.880030:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617042176 00000100:00100000:1.0:1789518235.880040:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617042176 00000100:00100000:1.0:1789518235.880100:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:1.0:1789518235.880110:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d429a188-2689-4f02-8a27-a318f1cbf37a+7:14386:x1876445617042176:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518235.880127:0:14409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518235.880143:0:14409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c78214e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcbd5 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518235.880250:0:14409:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789518235.880381:0:14409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c78214e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbd5 expref: 9 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.880398:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffe6f98900) 00010000:00010000:1.0:1789518235.880402:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789518235.880423:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c78214e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbd5 expref: 9 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.880568:0:14409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f6c00, rc 0) 00000100:00100000:1.0:1789518235.880757:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d429a188-2689-4f02-8a27-a318f1cbf37a+8:14386:x1876445617042176:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 647us (901us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1789518235.880765:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:1.0:1789518235.885013:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518235.885231:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617042432 00000100:00100000:3.0:1789518235.885239:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617042432 00000100:00100000:3.0:1789518235.885285:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:3.0:1789518235.885293:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4002680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d429a188-2689-4f02-8a27-a318f1cbf37a+8:14386:x1876445617042432:12345-192.168.206.51@tcp:36:lfs.0 00010000:00010000:3.0:1789518235.885336:0:14411:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518235.885359:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c782147 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbce expref: 8 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.885391:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99ffd2a17600) 00010000:00010000:3.0:1789518235.885402:0:14411:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518235.885422:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78215c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.885434:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78215c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.885442:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78215c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518235.885938:0:14411:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad8daf4f reply state 00000000e1bf848c transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78215c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518235.885949:0:14411:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789518235.885958:0:14411:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789518235.886217:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4002680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d429a188-2689-4f02-8a27-a318f1cbf37a+9:14386:x1876445617042432:12345-192.168.206.51@tcp:36:lfs.0 Request processed in 923us (1210us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789518235.886225:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:2.0:1789518235.889193:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518235.890904:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617042688 00000100:00100000:1.0:1789518235.890917:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617042688 00010000:00010000:3.0:1789518235.891071:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78215c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.891082:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78215c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.891090:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78215c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.891096:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518235.891100:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78215c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.891120:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78215c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.891135:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99ffe6f98300) 00010000:00010000:3.0:1789518235.891138:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1789518235.891144:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78215c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.891149:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78215c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518235.891217:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:1.0:1789518235.891228:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d429a188-2689-4f02-8a27-a318f1cbf37a+9:14386:x1876445617042688:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1789518235.891452:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d429a188-2689-4f02-8a27-a318f1cbf37a+9:14386:x1876445617042688:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 225us (2266us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789518235.891460:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:0.0:1789518235.895837:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518235.895932:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617042944 00000100:00100000:2.0:1789518235.895941:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617042944 00000100:00100000:2.0:1789518235.896052:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:2.0:1789518235.896152:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d429a188-2689-4f02-8a27-a318f1cbf37a+9:14386:x1876445617042944:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518235.896233:0:15115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518235.896252:0:15115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c782163 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcbdc expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.896329:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9800/0x631fd8698c78216a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.896342:0:15115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9800/0x631fd8698c78216a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.896353:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9800/0x631fd8698c78216a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.896365:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8000/0x631fd8698c782171 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.896372:0:15115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8000/0x631fd8698c782171 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.896379:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8000/0x631fd8698c782171 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518235.896479:0:15115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789518235.896587:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9800/0x631fd8698c78216a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.896594:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9800/0x631fd8698c78216a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.896600:0:15115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9800/0x631fd8698c78216a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.896605:0:15115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29c9800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518235.896609:0:15115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9800/0x631fd8698c78216a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.896660:0:15115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9800/0x631fd8698c78216a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.896671:0:15115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffe6f98900) 00010000:00010000:2.0:1789518235.896674:0:15115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518235.896678:0:15115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9800/0x631fd8698c78216a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.896684:0:15115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9800/0x631fd8698c78216a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.897803:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8000/0x631fd8698c782171 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.897815:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8000/0x631fd8698c782171 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.897822:0:15115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8000/0x631fd8698c782171 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.897842:0:15115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29c8000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518235.897846:0:15115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8000/0x631fd8698c782171 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.897852:0:15115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8000/0x631fd8698c782171 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.897864:0:15115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99ffd1b0c300) 00010000:00010000:2.0:1789518235.897867:0:15115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518235.897870:0:15115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8000/0x631fd8698c782171 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.897876:0:15115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8000/0x631fd8698c782171 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.897926:0:15115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c782163 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbdc expref: 11 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.897937:0:15115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffe6f98900) 00010000:00010000:2.0:1789518235.897939:0:15115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789518235.897943:0:15115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c782163 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbdc expref: 11 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.897954:0:15115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29c9200, rc 0) 00000100:00100000:2.0:1789518235.898018:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d429a188-2689-4f02-8a27-a318f1cbf37a+10:14386:x1876445617042944:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1957us (2189us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1789518235.898027:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:3.0:1789518235.901044:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518235.901248:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617043072 00000100:00100000:0.0:1789518235.901258:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617043072 00000100:00100000:0.0:1789518235.901348:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:0.0:1789518235.901358:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d429a188-2689-4f02-8a27-a318f1cbf37a+10:14386:x1876445617043072:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518235.901380:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518235.901401:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c78217f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcbe3 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.901488:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782186 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.901501:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782186 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.901541:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782186 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518235.901565:0:14410:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789518235.901569:0:14410:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518235.901583:0:14410:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782186 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.901608:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c78217f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbe3 expref: 12 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.901676:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782186 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbe3 expref: 11 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.901683:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99ffd2a17400) 00010000:00010000:0.0:1789518235.901686:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789518235.901690:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bca00, rc 0) 00000100:00100000:0.0:1789518235.901751:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d429a188-2689-4f02-8a27-a318f1cbf37a+11:14386:x1876445617043072:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 394us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518235.901758:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:3.0:1789518235.905990:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518235.906483:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617043200 00000100:00100000:2.0:1789518235.906501:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617043200 00000100:00100000:2.0:1789518235.906563:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:2.0:1789518235.906574:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d429a188-2689-4f02-8a27-a318f1cbf37a+11:14386:x1876445617043200:12345-192.168.206.51@tcp:37:lfs.0 00000100:00100000:2.0:1789518235.910155:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d429a188-2689-4f02-8a27-a318f1cbf37a+11:14386:x1876445617043200:12345-192.168.206.51@tcp:37:lfs.0 Request processed in 3573us (4166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518235.910167:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:3.0:1789518235.915237:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518235.915346:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617043456 00000100:00100000:1.0:1789518235.915355:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617043456 00000100:00100000:1.0:1789518235.915412:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:1.0:1789518235.915421:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd80c6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d429a188-2689-4f02-8a27-a318f1cbf37a+11:14386:x1876445617043456:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1789518235.915661:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd80c6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d429a188-2689-4f02-8a27-a318f1cbf37a+12:14386:x1876445617043456:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 241us (432us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789518235.915669:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:3.0:1789518235.953699:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518235.953776:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617043584 00000100:00100000:1.0:1789518235.953785:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617043584 00000100:00100000:1.0:1789518235.953880:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:1.0:1789518235.953889:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+10:14392:x1876445617043584:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:1.0:1789518235.953925:0:14409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518235.953944:0:14409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c78218d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcbea expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.953990:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c782194 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.954000:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c782194 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.954008:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c782194 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.954025:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c78219b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.954029:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c78219b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.954033:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c78219b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.954098:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7821a2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.954103:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7821a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.954107:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7821a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518235.954126:0:14409:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789518235.954132:0:14409:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518235.954163:0:14409:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7821a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.954171:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c782194 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.954176:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c782194 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.954180:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c782194 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.954184:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f6a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518235.954191:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c782194 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.954196:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c782194 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.954204:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffe6f98900) 00010000:00010000:1.0:1789518235.954206:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518235.954209:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c782194 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.954213:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6a00/0x631fd8698c782194 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.954222:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c78219b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.954225:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c78219b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.954237:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c78219b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.954240:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f6c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518235.954241:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c78219b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.954245:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c78219b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.954249:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99ffc2fdc900) 00010000:00010000:1.0:1789518235.954250:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518235.954252:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c78219b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.954256:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c78219b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.954283:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c78218d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbea expref: 12 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.954296:0:14409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7821a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbea expref: 11 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518235.954303:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99ffd2a17400) 00010000:00010000:1.0:1789518235.954305:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789518235.954307:0:14409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16c00, rc 0) 00000100:00100000:1.0:1789518235.954371:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+11:14392:x1876445617043584:12345-192.168.206.51@tcp:101:bash.0 Request processed in 482us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518235.954386:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:0.0:1789518235.957264:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518235.957336:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617043840 00000100:00100000:3.0:1789518235.957345:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617043840 00000100:00100000:3.0:1789518235.957396:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:3.0:1789518235.957406:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa777a5b-38aa-4d6a-adfe-237c479e59ff+11:14392:x1876445617043840:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:3.0:1789518235.957424:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518235.957442:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c7821a9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcbf1 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.957556:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c7821b0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.957570:0:14411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782186 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbe3 expref: 11 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.957596:0:14411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c7821b0 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.957664:0:14411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782186 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbe3 expref: 11 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.957677:0:14411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782186 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbe3 expref: 11 pid: 14410 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518235.957691:0:14411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffedb28380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14411:1876445627504256:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518235.957771:0:14411:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffe0502540 going to sleep for 11 seconds 00000100:00100000:0.0:1789518235.959506:0:14411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffedb28380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14411:1876445627504256:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518235.959539:0:14411:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c7821b0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518235.960356:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518235.960403:0:16517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617043968 00000100:00100000:3.0:1789518235.960410:0:16517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617043968 00010000:00010000:3.0:1789518235.960444:0:16517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782186 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbe3 expref: 12 pid: 14410 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518235.960535:0:16517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:3.0:1789518235.960545:0:16517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d429a188-2689-4f02-8a27-a318f1cbf37a+12:2342:x1876445617043968:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518235.960559:0:16517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518235.960566:0:16517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782186 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbe3 expref: 12 pid: 14410 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.960579:0:16517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782186 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbe3 expref: 12 pid: 14410 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.960599:0:16517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782186 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbe3 expref: 12 pid: 14410 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.960662:0:16517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99ffd2a17400) 00010000:00010000:3.0:1789518235.960667:0:16517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c7821b0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.960676:0:16517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c7821b0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.960683:0:16517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c7821b0 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.960702:0:16517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518235.960753:0:16517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d429a188-2689-4f02-8a27-a318f1cbf37a+11:2342:x1876445617043968:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 209us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518235.960760:0:16517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00010000:00010000:0.0:1789518235.960764:0:14411:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c7821b0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.960777:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c7821b0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.960797:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7821b7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.960807:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7821b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.960815:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7821b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.962122:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c7821be lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.962135:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c7821be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.962144:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c7821be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518235.962154:0:14411:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789518235.962179:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c7821b0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.962186:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c7821b0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.962192:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c7821b0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.962254:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518235.962264:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c7821b0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.962272:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c7821b0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.962284:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99ffd2a17400) 00010000:00010000:0.0:1789518235.962287:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518235.962290:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c7821b0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.962361:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c7821b0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518235.962377:0:14411:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000033875ddd reply state 00000000f6326fc5 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7821b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518235.962385:0:14411:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789518235.962417:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c7821a9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbf1 expref: 14 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.962444:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c7821be lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbf1 expref: 13 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518235.962451:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffd2a17700) 00010000:00010000:0.0:1789518235.962454:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1789518235.962456:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd400, rc 0) 00000100:00100000:0.0:1789518235.962525:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa777a5b-38aa-4d6a-adfe-237c479e59ff+14:14392:x1876445617043840:12345-192.168.206.51@tcp:101:bash.0 Request processed in 5120us (5268us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1789518235.962537:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 27 00010000:00010000:2.0:1789518235.964469:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7821b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.964483:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7821b7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.964491:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7821b7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.964497:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518235.964501:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7821b7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.964518:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7821b7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.964530:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff99ffd2a17e00) 00010000:00010000:2.0:1789518235.964533:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518235.964537:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7821b7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518235.964543:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7821b7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518235.976710:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518235.976953:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617044096 00000100:00100000:3.0:1789518235.976966:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617044096 00000100:00100000:3.0:1789518235.977116:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:3.0:1789518235.977130:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa777a5b-38aa-4d6a-adfe-237c479e59ff+13:14392:x1876445617044096:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:3.0:1789518235.977162:0:15115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518235.977190:0:15115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7821cc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcbf8 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.977298:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7821d3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.977316:0:15115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7821d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.977343:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7821d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518235.977395:0:15115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789518235.977400:0:15115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518235.977439:0:15115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7821d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.977452:0:15115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7821d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.977482:0:15115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7821cc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbf8 expref: 15 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.977504:0:15115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7821d3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbf8 expref: 14 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518235.977522:0:15115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffd2a17700) 00010000:00010000:3.0:1789518235.977525:0:15115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518235.977531:0:15115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6800, rc 0) 00000100:00100000:3.0:1789518235.977799:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa777a5b-38aa-4d6a-adfe-237c479e59ff+14:14392:x1876445617044096:12345-192.168.206.51@tcp:101:bash.0 Request processed in 489us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518235.977808:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:0.0:1789518235.982294:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518235.982449:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617044352 00000100:00100000:1.0:1789518235.982463:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617044352 00000100:00100000:1.0:1789518235.982544:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:1.0:1789518235.982557:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+14:14392:x1876445617044352:12345-192.168.206.51@tcp:35:bash.0 00000100:00100000:1.0:1789518235.984877:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+15:14392:x1876445617044352:12345-192.168.206.51@tcp:35:bash.0 Request processed in 2311us (2585us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1789518235.984891:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:0.0:1789518236.048951:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518236.049174:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617044608 00000100:00100000:3.0:1789518236.049184:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617044608 00000100:00100000:3.0:1789518236.049282:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:3.0:1789518236.049292:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+15:14402:x1876445617044608:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518236.049314:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518236.049348:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7821da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcbff expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518236.049458:0:14410:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789518236.049586:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7821da lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbff expref: 17 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.049601:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffe6f98900) 00010000:00010000:3.0:1789518236.049604:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789518236.049609:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7821da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbff expref: 17 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.049661:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6a00, rc 0) 00000100:00100000:3.0:1789518236.049726:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+16:14402:x1876445617044608:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 434us (782us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1789518236.049735:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:2.0:1789518236.053789:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518236.053975:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617044864 00000100:00100000:1.0:1789518236.054164:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617044864 00000100:00100000:1.0:1789518236.054279:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:1.0:1789518236.054292:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+16:14402:x1876445617044864:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1789518236.054792:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+17:14402:x1876445617044864:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 500us (1014us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1789518236.054801:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:1.0:1789518236.088215:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518236.090661:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617045120 00000100:00100000:2.0:1789518236.090682:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617045120 00000100:00100000:2.0:1789518236.090840:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:2.0:1789518236.090859:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4001880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+17:14405:x1876445617045120:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518236.090893:0:14409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518236.090921:0:14409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9800/0x631fd8698c7821e8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcc06 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.091066:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8000/0x631fd8698c7821ef lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.091098:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8000/0x631fd8698c7821ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.091115:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8000/0x631fd8698c7821ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518236.091127:0:14409:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789518236.091282:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9800/0x631fd8698c7821e8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc06 expref: 20 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.091312:0:14409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8000/0x631fd8698c7821ef lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc06 expref: 19 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.091322:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffd2a17700) 00010000:00010000:2.0:1789518236.091325:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518236.091330:0:14409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29c8000, rc 0) 00000100:00100000:2.0:1789518236.091426:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4001880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+19:14405:x1876445617045120:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 574us (3235us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1789518236.091451:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:0.0:1789518236.093965:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518236.094009:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518236.094213:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617045248 00000100:00100000:3.0:1789518236.094223:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617045248 00000100:00100000:3.0:1789518236.094279:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:3.0:1789518236.094290:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa777a5b-38aa-4d6a-adfe-237c479e59ff+19:14405:x1876445617045248:12345-192.168.206.51@tcp:54:lfs.0 00010000:00010000:3.0:1789518236.094351:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7821fd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.094367:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7821fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.094383:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7821fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.094424:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7821fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.094431:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7821fd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.094438:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7821fd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.094445:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518236.094449:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7821fd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.094456:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7821fd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.094468:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffd2a17700) 00010000:00010000:3.0:1789518236.094471:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789518236.094476:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7821fd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.094482:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7821fd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518236.094871:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617045376 00000100:00100000:2.0:1789518236.094887:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617045376 00000100:00100000:2.0:1789518236.094965:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:2.0:1789518236.094978:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa777a5b-38aa-4d6a-adfe-237c479e59ff+20:2342:x1876445617045376:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518236.094995:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518236.095022:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8000/0x631fd8698c7821ef lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc06 expref: 20 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.095043:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffd2a17700) 00010000:00010000:2.0:1789518236.095048:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518236.095162:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa777a5b-38aa-4d6a-adfe-237c479e59ff+19:14405:x1876445617045248:12345-192.168.206.51@tcp:54:lfs.0 Request processed in 871us (1203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518236.095172:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:2.0:1789518236.095552:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa777a5b-38aa-4d6a-adfe-237c479e59ff+18:2342:x1876445617045376:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 573us (1537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518236.095563:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:0.0:1789518236.097968:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518236.098058:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617045632 00000100:00100000:2.0:1789518236.098077:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617045632 00000100:00100000:2.0:1789518236.098134:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:2.0:1789518236.098143:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+18:14405:x1876445617045632:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:2.0:1789518236.099039:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+19:14405:x1876445617045632:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 893us (1075us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1789518236.099049:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:1.0:1789518236.271422:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518236.272438:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617045888 00000100:00100000:3.0:1789518236.272453:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617045888 00000100:00100000:3.0:1789518236.272637:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:3.0:1789518236.272659:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa777a5b-38aa-4d6a-adfe-237c479e59ff+19:14436:x1876445617045888:12345-192.168.206.51@tcp:101:cat.0 00010000:00010000:3.0:1789518236.272682:0:15115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518236.272702:0:15115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c782204 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcc0d expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.272880:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78220b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.272896:0:15115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78220b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.272908:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78220b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518236.272920:0:15115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789518236.273055:0:15115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c782204 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc0d expref: 22 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.273143:0:15115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78220b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc0d expref: 21 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.273152:0:15115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffd2a17700) 00010000:00010000:3.0:1789518236.273155:0:15115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518236.273158:0:15115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c7200, rc 0) 00000100:00100000:3.0:1789518236.273225:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa777a5b-38aa-4d6a-adfe-237c479e59ff+21:14436:x1876445617045888:12345-192.168.206.51@tcp:101:cat.0 Request processed in 568us (1811us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1789518236.273233:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:0.0:1789518236.278587:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518236.278682:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617046016 00000100:00100000:1.0:1789518236.278691:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617046016 00000100:00100000:1.0:1789518236.278754:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:1.0:1789518236.278763:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+21:2343:x1876445617046016:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518236.278776:0:14396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518236.278798:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78220b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc0d expref: 21 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.278830:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffd2a17700) 00010000:00010000:1.0:1789518236.278835:0:14396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518236.279143:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+20:2343:x1876445617046016:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 379us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518236.279150:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:2.0:1789518236.284133:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518236.284388:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617046272 00000100:00100000:3.0:1789518236.284398:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617046272 00000100:00100000:3.0:1789518236.284474:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:3.0:1789518236.284484:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+20:14436:x1876445617046272:12345-192.168.206.51@tcp:35:cat.0 00000100:00100000:1.0:1789518236.285493:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+21:14436:x1876445617046272:12345-192.168.206.51@tcp:35:cat.0 Request processed in 1006us (1364us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1789518236.285503:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:0.0:1789518236.324101:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518236.324176:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617046528 00000100:00100000:2.0:1789518236.324186:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617046528 00000100:00100000:2.0:1789518236.324364:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:2.0:1789518236.324376:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+21:14442:x1876445617046528:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:2.0:1789518236.324410:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518236.324428:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8000/0x631fd8698c782219 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcc14 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.324534:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9800/0x631fd8698c782220 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.324548:0:14410:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c7821be lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbf1 expref: 22 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.324555:0:14410:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7821d3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbf8 expref: 22 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.324563:0:14410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9800/0x631fd8698c782220 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.324594:0:14410:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7821d3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbf8 expref: 22 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.324608:0:14410:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7821d3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbf8 expref: 22 pid: 15115 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518236.324646:0:14410:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14410:1876445627504384:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518236.324768:0:14410:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c7821be lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbf1 expref: 22 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.324778:0:14410:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c7821be lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbf1 expref: 22 pid: 14411 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518236.324801:0:14410:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14410:1876445627504512:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518236.324830:0:14410:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffdb558cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518236.327909:0:14410:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14410:1876445627504384:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518236.327917:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518236.327930:0:14410:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14410:1876445627504512:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518236.327956:0:14410:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9800/0x631fd8698c782220 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518236.327992:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518236.328116:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617046656 00000100:00100000:2.0:1789518236.328116:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617046784 00000100:00100000:2.0:1789518236.328123:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617046784 00000100:00100000:3.0:1789518236.328124:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617046656 00010000:00010000:2.0:1789518236.328153:0:14397:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c7821be lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbf1 expref: 24 pid: 14411 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.328156:0:14395:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7821d3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbf8 expref: 24 pid: 15115 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518236.328186:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:2.0:1789518236.328193:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa777a5b-38aa-4d6a-adfe-237c479e59ff+24:2342:x1876445617046784:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518236.328204:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518236.328209:0:14397:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c7821be lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbf1 expref: 24 pid: 14411 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.328217:0:14397:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c7821be lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbf1 expref: 24 pid: 14411 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.328241:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c7821be lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbf1 expref: 24 pid: 14411 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.328258:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffd2a17700) 00000100:00100000:3.0:1789518236.328264:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00010000:00010000:2.0:1789518236.328272:0:14397:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9800/0x631fd8698c782220 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518236.328277:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc33c4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+23:2343:x1876445617046656:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518236.328281:0:14397:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9800/0x631fd8698c782220 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.328287:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518236.328288:0:14395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518236.328295:0:14395:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7821d3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbf8 expref: 23 pid: 15115 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.328307:0:14395:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7821d3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbf8 expref: 23 pid: 15115 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.328322:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7821d3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcbf8 expref: 23 pid: 15115 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518236.328326:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa777a5b-38aa-4d6a-adfe-237c479e59ff+23:2342:x1876445617046784:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 132us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518236.328339:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00010000:00010000:3.0:1789518236.328344:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffd2a17700) 00010000:00010000:3.0:1789518236.328350:0:14395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9800/0x631fd8698c782220 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.328365:0:14395:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9800/0x631fd8698c782220 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.328373:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9800/0x631fd8698c782220 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.328408:0:14395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518236.328441:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc33c4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+21:2343:x1876445617046656:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 167us (528us total) trans 0 rc 0/0 00010000:00010000:2.0:1789518236.328443:0:14410:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9800/0x631fd8698c782220 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518236.328453:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00010000:00010000:2.0:1789518236.328467:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9800/0x631fd8698c782220 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518236.328486:0:14410:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789518236.328804:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8000/0x631fd8698c782219 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc14 expref: 22 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.328816:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9800/0x631fd8698c782220 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc14 expref: 21 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.328821:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffd2a17700) 00010000:00010000:2.0:1789518236.328823:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789518236.328824:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29c9800, rc 0) 00000100:00100000:2.0:1789518236.328904:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+21:14442:x1876445617046528:12345-192.168.206.51@tcp:101:dd.0 Request processed in 4531us (4812us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1789518236.328909:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:2.0:1789518236.331302:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518236.331390:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617047040 00000100:00100000:1.0:1789518236.331398:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617047040 00000100:00100000:1.0:1789518236.331442:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:1.0:1789518236.331461:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+21:14442:x1876445617047040:12345-192.168.206.51@tcp:36:dd.0 00010000:00010000:1.0:1789518236.331762:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78222e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.331779:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78222e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.331790:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78222e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789518236.331839:0:14409:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1789518236.331876:0:14409:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006344799a reply state 0000000022f6cf78 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78222e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518236.331885:0:14409:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789518236.331967:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+24:14442:x1876445617047040:12345-192.168.206.51@tcp:36:dd.0 Request processed in 516us (670us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1789518236.331982:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 34 00000020:00080000:1.0:1789518236.331987:0:14409:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789518236.333342:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78222e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.333352:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78222e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.333367:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78222e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.333371:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518236.333376:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78222e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.333384:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78222e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.333397:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffd2a17700) 00010000:00010000:3.0:1789518236.333400:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518236.333405:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78222e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.333411:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78222e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518236.334112:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518236.334209:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617047168 00000100:00100000:3.0:1789518236.334218:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617047168 00000100:00100000:3.0:1789518236.334327:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:3.0:1789518236.334338:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa777a5b-38aa-4d6a-adfe-237c479e59ff+23:14442:x1876445617047168:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:3.0:1789518236.334356:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518236.334376:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c782235 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcc1b expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.334426:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c782235 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc1b expref: 24 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.334438:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c782235 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc1b expref: 24 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.334454:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffd2a17700) 00010000:00010000:3.0:1789518236.334456:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518236.334459:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6a00, rc 0) 00000100:00100000:3.0:1789518236.334522:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa777a5b-38aa-4d6a-adfe-237c479e59ff+24:14442:x1876445617047168:12345-192.168.206.51@tcp:101:dd.0 Request processed in 186us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518236.334530:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:0.0:1789518236.344572:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518236.344740:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617047424 00000100:00100000:2.0:1789518236.344749:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617047424 00000100:00100000:2.0:1789518236.344817:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:2.0:1789518236.344828:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa777a5b-38aa-4d6a-adfe-237c479e59ff+24:14442:x1876445617047424:12345-192.168.206.51@tcp:103:dd.0 00010000:00010000:2.0:1789518236.344842:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518236.344865:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c782235 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc1b expref: 24 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.344882:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffd2a17700) 00010000:00010000:2.0:1789518236.344886:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518236.344943:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa777a5b-38aa-4d6a-adfe-237c479e59ff+23:14442:x1876445617047424:12345-192.168.206.51@tcp:103:dd.0 Request processed in 117us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518236.344951:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:1.0:1789518236.347207:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518236.347291:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617047552 00000100:00100000:3.0:1789518236.347299:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617047552 00000100:00100000:3.0:1789518236.347349:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:3.0:1789518236.347359:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4000700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa777a5b-38aa-4d6a-adfe-237c479e59ff+23:14442:x1876445617047552:12345-192.168.206.51@tcp:58:dd.0 00010000:00010000:3.0:1789518236.347449:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78223c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.347465:0:15115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78223c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.347492:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78223c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789518236.348904:0:15115:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789518236.348980:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1789518236.349355:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1789518236.349476:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4000700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa777a5b-38aa-4d6a-adfe-237c479e59ff+23:14442:x1876445617047552:12345-192.168.206.51@tcp:58:dd.0 Request processed in 2115us (2272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518236.349486:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:0.0:1789518236.351375:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518236.351598:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617047680 00000100:00100000:2.0:1789518236.351608:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617047680 00000100:00100000:2.0:1789518236.351706:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00100000:2.0:1789518236.351716:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+23:14442:x1876445617047680:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:2.0:1789518236.351734:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518236.351753:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8000/0x631fd8698c782243 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcc22 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.351803:0:14410:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78223c lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.351814:0:14410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8000/0x631fd8698c782243 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc22 expref: 24 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.351846:0:14410:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78223c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.351860:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8000/0x631fd8698c782243 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc22 expref: 24 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.351872:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffd2a17700) 00010000:00010000:2.0:1789518236.351875:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518236.351879:0:14410:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8000/0x631fd8698c782243 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc22 expref: 24 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.351887:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29c8000, rc 0) 00000100:00100000:2.0:1789518236.351935:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+24:14442:x1876445617047680:12345-192.168.206.51@tcp:101:dd.0 Request processed in 222us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518236.351942:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 37 00010000:00010000:2.0:1789518236.403044:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789518236.594872:0:14443:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789518236.594881:0:14443:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518236.594919:0:14443:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789518236.594925:0:14443:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789518236.595038:0:14443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28ae300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14443:1876445627504640:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789518236.595240:0:14443:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbe240 going to sleep for 11 seconds 00000100:00100000:1.0:1789518236.598216:0:14443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28ae300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14443:1876445627504640:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789518236.601374:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518236.601745:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617047808 00000100:00100000:0.0:1789518236.601754:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617047808 00000100:00100000:0.0:1789518236.601842:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:0.0:1789518236.601853:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4001c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+24:14443:x1876445617047808:12345-192.168.206.51@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789518236.601931:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4001c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+24:14443:x1876445617047808:12345-192.168.206.51@tcp:900:lhsmtool_posix.0 Request processed in 80us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518236.601950:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:0.0:1789518236.604271:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518236.604479:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617047936 00000100:00100000:1.0:1789518236.604488:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617047936 00000100:00100000:1.0:1789518236.604547:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:1.0:1789518236.604556:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+24:14443:x1876445617047936:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789518236.604583:0:14409:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789518236.605054:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+24:14443:x1876445617047936:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 497us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518236.605073:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:2.0:1789518236.611012:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518236.611266:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617048064 00000100:00100000:3.0:1789518236.611275:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617048064 00000100:00100000:3.0:1789518236.611321:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 39 00000100:00100000:3.0:1789518236.611330:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa777a5b-38aa-4d6a-adfe-237c479e59ff+24:14443:x1876445617048064:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789518236.611398:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78224a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.611411:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78224a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.611419:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78224a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.611474:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c782251 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.611490:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c782251 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.611495:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c782251 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.611525:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c782258 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.611534:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c782258 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.611557:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c782258 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518236.611599:0:14411:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789518236.611604:0:14411:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518236.611661:0:14411:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c782258 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.611672:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78224a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.611677:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78224a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.611681:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78224a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.611685:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518236.611687:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78224a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.611692:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78224a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.611700:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffd2a17500) 00010000:00010000:3.0:1789518236.611702:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518236.611705:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78224a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.611708:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78224a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.611725:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c782251 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.611728:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c782251 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.611732:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c782251 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.611735:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518236.611736:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c782251 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.611739:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c782251 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.611743:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff99ffe6f98300) 00010000:00010000:3.0:1789518236.611745:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518236.611746:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c782251 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.611749:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c782251 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.611758:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c782258 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.611761:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c782258 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.611764:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c782258 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.611771:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518236.611772:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c782258 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.611776:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c782258 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.611780:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffd2a17700) 00010000:00010000:3.0:1789518236.611781:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518236.611783:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c782258 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.611786:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c782258 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518236.611952:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa777a5b-38aa-4d6a-adfe-237c479e59ff+24:14443:x1876445617048064:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 Request processed in 621us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518236.611959:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 39 00000100:00100000:2.0:1789518236.615146:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518236.615362:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617048320 00000100:00100000:0.0:1789518236.615370:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617048320 00000100:00100000:0.0:1789518236.615439:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 40 00000100:00100000:0.0:1789518236.615449:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa777a5b-38aa-4d6a-adfe-237c479e59ff+24:14443:x1876445617048320:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518236.615467:0:15115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518236.615486:0:15115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c78225f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcc29 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.615583:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c782266 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.615597:0:15115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c782266 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.615608:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c782266 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518236.615660:0:15115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789518236.615746:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c782266 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.615754:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c782266 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.615761:0:15115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c782266 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.615767:0:15115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518236.615781:0:15115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c782266 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.615799:0:15115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c782266 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.615811:0:15115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffd2a17700) 00010000:00010000:0.0:1789518236.615813:0:15115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789518236.615818:0:15115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c782266 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.615824:0:15115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c782266 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.616083:0:15115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c78225f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc29 expref: 26 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.616094:0:15115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffd2a17500) 00010000:00010000:0.0:1789518236.616097:0:15115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789518236.616100:0:15115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c78225f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc29 expref: 26 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.616111:0:15115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc400, rc 0) 00000100:00100000:0.0:1789518236.616175:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa777a5b-38aa-4d6a-adfe-237c479e59ff+25:14443:x1876445617048320:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 727us (1036us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1789518236.616183:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 40 00000100:00100000:0.0:1789518236.619170:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518236.619303:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617048448 00000100:00100000:2.0:1789518236.619312:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617048448 00000100:00100000:2.0:1789518236.619365:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:2.0:1789518236.619376:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+25:14443:x1876445617048448:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789518236.619407:0:14410:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789518236.619521:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+25:14443:x1876445617048448:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 146us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518236.619532:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:2.0:1789518236.623992:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518236.624122:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617048704 00000100:00100000:1.0:1789518236.624131:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617048704 00000100:00100000:1.0:1789518236.624213:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:1.0:1789518236.624223:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+25:14443:x1876445617048704:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518236.624242:0:14409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518236.624262:0:14409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c782274 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcc30 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789518236.624963:0:14409:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:1.0:1789518236.624969:0:14409:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:1.0:1789518236.625022:0:14409:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:1.0:1789518236.625267:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c78227b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.625287:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c78227b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.625299:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c78227b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.625354:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c782274 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc30 expref: 28 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.625372:0:14409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c78227b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc30 expref: 27 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.625380:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99ffc2fdc900) 00010000:00010000:1.0:1789518236.625383:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789518236.625386:0:14409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16200, rc 0) 00000100:00100000:1.0:1789518236.625436:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+27:14443:x1876445617048704:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1215us (1452us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1789518236.625444:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:1.0:1789518236.630419:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518236.630734:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617048960 00000100:00100000:3.0:1789518236.630743:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617048960 00000100:00100000:2.0:1789518236.630927:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 43 00000100:00100000:2.0:1789518236.630939:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4000e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa777a5b-38aa-4d6a-adfe-237c479e59ff+27:14443:x1876445617048960:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789518236.630997:0:14411:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518236.631023:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c78227b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc30 expref: 27 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.631039:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99ffc2fdc900) 00010000:00010000:2.0:1789518236.631048:0:14411:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518236.631176:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9e00/0x631fd8698c782289 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.631189:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9e00/0x631fd8698c782289 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.631199:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9e00/0x631fd8698c782289 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.631213:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8800/0x631fd8698c782290 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x543b2b80 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.631220:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8800/0x631fd8698c782290 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x543b2b80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.631227:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8800/0x631fd8698c782290 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x543b2b80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.631281:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9e00/0x631fd8698c782289 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.631288:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9e00/0x631fd8698c782289 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.631306:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9e00/0x631fd8698c782289 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.631312:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29c9e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518236.631316:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9e00/0x631fd8698c782289 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.631324:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9e00/0x631fd8698c782289 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.631333:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99ffd2a17400) 00010000:00010000:2.0:1789518236.631335:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518236.631339:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9e00/0x631fd8698c782289 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.631345:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9e00/0x631fd8698c782289 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.631358:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8800/0x631fd8698c782290 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x543b2b80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.631364:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8800/0x631fd8698c782290 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x543b2b80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.631369:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8800/0x631fd8698c782290 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x543b2b80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.631373:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29c8800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518236.631376:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8800/0x631fd8698c782290 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x543b2b80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.631391:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8800/0x631fd8698c782290 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x543b2b80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.631399:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x543b2b80 (ffff99ffd1b0c300) 00010000:00010000:2.0:1789518236.631402:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518236.631404:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8800/0x631fd8698c782290 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x543b2b80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.631410:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8800/0x631fd8698c782290 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x543b2b80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518236.631884:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4000e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa777a5b-38aa-4d6a-adfe-237c479e59ff+26:14443:x1876445617048960:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 946us (1471us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789518236.631892:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 43 00000100:00100000:2.0:1789518236.633898:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518236.634019:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617049088 00000100:00100000:0.0:1789518236.634027:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617049088 00000100:00100000:0.0:1789518236.634123:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:0.0:1789518236.634145:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa777a5b-38aa-4d6a-adfe-237c479e59ff+26:14443:x1876445617049088:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518236.634173:0:15115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518236.634203:0:15115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c782297 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcc37 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.634235:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c78229e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.634252:0:15115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c78229e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.634263:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c78229e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.634346:0:15115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c782297 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc37 expref: 28 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.634367:0:15115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c78229e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc37 expref: 27 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.634375:0:15115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99ffd2a17f00) 00010000:00010000:0.0:1789518236.634378:0:15115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789518236.634381:0:15115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd400, rc 0) 00000100:00100000:0.0:1789518236.634573:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa777a5b-38aa-4d6a-adfe-237c479e59ff+27:14443:x1876445617049088:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 428us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518236.634580:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:0.0:1789518236.637038:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518236.637203:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617049344 00000100:00100000:2.0:1789518236.637213:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617049344 00000100:00100000:2.0:1789518236.637296:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 45 00000100:00100000:2.0:1789518236.637306:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+27:14443:x1876445617049344:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789518236.637376:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c7822a5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.637390:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c7822a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.637400:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c7822a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789518236.637754:0:14410:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1789518236.637776:0:14410:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 290634161439ns, next at 291634158919ns, rc = 0 00000004:00010000:2.0:1789518236.637852:0:14410:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002518240d reply state 00000000e573bc1a transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c7822a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518236.637860:0:14410:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518236.638149:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+29:14443:x1876445617049344:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 842us (1115us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1789518236.638168:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 45 00010000:00010000:2.0:1789518236.639557:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c7822a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.639571:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c7822a5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.639578:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c7822a5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.639583:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29c9200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518236.639588:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c7822a5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.639595:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c7822a5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.639608:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99ffd2a17f00) 00010000:00010000:2.0:1789518236.639708:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789518236.639714:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c7822a5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.639720:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c7822a5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518236.640884:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518236.640953:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617049472 00000100:00100000:1.0:1789518236.640962:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617049472 00000100:00100000:1.0:1789518236.641016:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 46 00000100:00100000:1.0:1789518236.641026:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+28:14443:x1876445617049472:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518236.641046:0:14409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518236.641067:0:14409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7822ac lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcc3e expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.641314:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7822ac lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc3e expref: 29 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.641327:0:14409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7822ac lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc3e expref: 29 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.641345:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99ffd2a17f00) 00010000:00010000:1.0:1789518236.641347:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789518236.641350:0:14409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17400, rc 0) 00000100:00100000:1.0:1789518236.641410:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+29:14443:x1876445617049472:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 385us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518236.641417:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 46 00000100:00100000:1.0:1789518236.644220:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518236.644304:0:16281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617049600 00000100:00100000:3.0:1789518236.644312:0:16281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617049600 00000100:00100000:3.0:1789518236.644364:0:16281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:3.0:1789518236.644374:0:16281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4000380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa777a5b-38aa-4d6a-adfe-237c479e59ff+5:2343:x1876445617049600:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789518236.644721:0:16281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4000380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa777a5b-38aa-4d6a-adfe-237c479e59ff+6:2343:x1876445617049600:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 347us (507us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789518236.644728:0:16281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:3.0:1789518236.646527:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518236.646681:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617049856 00000100:00100000:1.0:1789518236.646689:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617049856 00000100:00100000:1.0:1789518236.646830:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:1.0:1789518236.646841:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+29:14443:x1876445617049856:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789518236.647416:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+30:14443:x1876445617049856:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 576us (893us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1789518236.647425:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:0.0:1789518236.649711:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518236.649926:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617050112 00000100:00100000:2.0:1789518236.649933:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617050112 00000100:00100000:0.0:1789518236.650128:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:0.0:1789518236.650138:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+30:14443:x1876445617050112:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789518236.650370:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+30:14443:x1876445617050112:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 232us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518236.650378:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:0.0:1789518236.654518:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518236.655074:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617050240 00000100:00100000:1.0:1789518236.655084:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617050240 00000100:00100000:1.0:1789518236.655146:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:1.0:1789518236.655156:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+30:14443:x1876445617050240:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518236.655175:0:14409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518236.655208:0:14409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7822b3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcc45 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.655272:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c7822ba lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.655286:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c7822ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.655296:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c7822ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518236.655328:0:14409:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518236.655346:0:14409:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c7822ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.655372:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7822b3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc45 expref: 32 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.655391:0:14409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c7822ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc45 expref: 31 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.655399:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99ffd2a17f00) 00010000:00010000:1.0:1789518236.655402:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789518236.655405:0:14409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17e00, rc 0) 00000100:00100000:1.0:1789518236.655471:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+31:14443:x1876445617050240:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 316us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518236.655488:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:3.0:1789518236.657793:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518236.658087:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617050368 00000100:00100000:2.0:1789518236.658095:0:15091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617050368 00000100:00100000:2.0:1789518236.658140:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:2.0:1789518236.658149:0:15091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+6:2342:x1876445617050368:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518236.658165:0:15091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518236.658194:0:15091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017ddd459/0x631fd8698c7822c1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcc4c expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518236.658219:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa9e19d, blocks: 0x1 00010000:00010000:2.0:1789518236.658235:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=290s v=(0 0) 00010000:00010000:2.0:1789518236.658239:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518236.658247:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017ddd459/0x631fd8698c7822c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc4c expref: 7 pid: 15091 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.658263:0:15091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000017ddd459/0x631fd8698c7822c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc4c expref: 7 pid: 15091 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.658284:0:15091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29c9e00, rc 0) 00000100:00100000:2.0:1789518236.658331:0:15091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+7:2342:x1876445617050368:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 183us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518236.658339:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:2.0:1789518236.662302:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518236.662492:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617050624 00000100:00100000:0.0:1789518236.662503:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617050624 00000100:00100000:0.0:1789518236.662575:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:0.0:1789518236.662585:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+31:14443:x1876445617050624:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789518236.662713:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+31:14443:x1876445617050624:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 129us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518236.662721:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:0.0:1789518236.668251:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518236.668488:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617050752 00000100:00100000:1.0:1789518236.668498:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617050752 00000100:00100000:1.0:1789518236.668584:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00100000:1.0:1789518236.668594:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6503480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+31:14443:x1876445617050752:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789518236.707064:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934611 is committed 00000001:00080000:0.0:1789518236.707090:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:0.0:1789518236.707105:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000004:00080000:0.0:1789518236.707117:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1789518236.707294:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6503480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+14:14443:x1876445617050752:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 Request processed in 38697us (39048us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518236.707304:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00100000:0.0:1789518236.707636:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789518236.707649:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4000000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627504768:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789518236.707691:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518236.707788:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627504768 00000100:00100000:1.0:1789518236.707796:0:15092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627504768 00000100:00100000:1.0:1789518236.707847:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789518236.707855:0:15092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627504768:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789518236.707987:0:15092:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789518236.707990:0:15092:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1789518236.707992:0:15092:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789518236.707994:0:15092:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789518237 -> 1789518237 00002000:00010000:1.0:1789518236.707996:0:15092:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789518236.708031:0:15092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627504768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 177us (338us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1789518236.708039:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789518236.708053:0:3281:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789518236.708079:0:3281:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff99fff4000000 x1876445627504768/t8589934595(8589934595) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789518252 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1789518236.708089:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fff4000000/2, rc 0, transno 8589934595 00000100:00100000:2.0:1789518236.708094:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4000000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627504768:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1789518236.708104:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518236.711907:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518236.712313:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617050880 00000100:00100000:0.0:1789518236.712321:0:15093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617050880 00000100:00100000:0.0:1789518236.712379:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:0.0:1789518236.712389:0:15093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa777a5b-38aa-4d6a-adfe-237c479e59ff+7:2343:x1876445617050880:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789518236.712528:0:15093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa777a5b-38aa-4d6a-adfe-237c479e59ff+7:2343:x1876445617050880:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 Request processed in 139us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518236.712535:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:0.0:1789518236.715652:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518236.715724:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617051136 00000100:00100000:2.0:1789518236.715733:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617051136 00000100:00100000:2.0:1789518236.715789:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 51 00000100:00100000:2.0:1789518236.715799:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+14:14443:x1876445617051136:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789518236.715847:0:14410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518236.715873:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c7822ba lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc45 expref: 14 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.715892:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99ffd2a17f00) 00010000:00010000:2.0:1789518236.715897:0:14410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518236.715926:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c7822c8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.715939:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c7822c8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.715950:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c7822c8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518236.716405:0:14410:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000084f82003 reply state 00000000922cce2d transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c7822c8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518236.716416:0:14410:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518236.716566:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+15:14443:x1876445617051136:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 767us (959us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1789518236.716589:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 51 00010000:00010000:1.0:1789518236.718938:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c7822c8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.718955:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c7822c8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.718962:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c7822c8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.718968:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29c9200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518236.718973:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c7822c8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.718980:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c7822c8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.719012:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99ffd2a17f00) 00010000:00010000:1.0:1789518236.719015:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518236.719020:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c7822c8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.719026:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c9200/0x631fd8698c7822c8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518236.720312:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518236.720544:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617051264 00000100:00100000:1.0:1789518236.720554:0:15092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617051264 00000100:00100000:1.0:1789518236.720607:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:1.0:1789518236.720646:0:15092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+7:2343:x1876445617051264:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789518236.720828:0:15092:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789518236.720831:0:15092:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789518236 00002000:00010000:1.0:1789518236.720834:0:15092:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789518236 00002000:00010000:1.0:1789518236.720836:0:15092:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789518237 -> 1789518236 00002000:00010000:1.0:1789518236.720839:0:15092:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789518236.720898:0:15092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+8:2343:x1876445617051264:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 256us (592us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1789518236.720907:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:3.0:1789518236.722148:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518236.722225:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617051392 00000100:00100000:2.0:1789518236.722233:0:15091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617051392 00000100:00100000:2.0:1789518236.722280:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:2.0:1789518236.722289:0:15091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+8:2342:x1876445617051392:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789518236.722319:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000df0eeec/0x631fd8698c7822cf lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.722335:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518236.722339:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518236.722345:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000df0eeec/0x631fd8698c7822cf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.722369:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000df0eeec/0x631fd8698c7822cf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.722392:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000df0eeec/0x631fd8698c7822cf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.722399:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000df0eeec/0x631fd8698c7822cf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.722407:0:15091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000df0eeec/0x631fd8698c7822cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.722414:0:15091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29c8800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518236.722439:0:15091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000df0eeec/0x631fd8698c7822cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.722449:0:15091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000df0eeec/0x631fd8698c7822cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.722463:0:15091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000df0eeec/0x631fd8698c7822cf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.722471:0:15091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000df0eeec/0x631fd8698c7822cf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518236.722551:0:15091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+8:2342:x1876445617051392:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 Request processed in 262us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518236.722559:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:3.0:1789518236.724895:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518236.724964:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617051648 00000100:00100000:0.0:1789518236.724973:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617051648 00000100:00100000:0.0:1789518236.725030:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 52 00000100:00100000:0.0:1789518236.725040:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa777a5b-38aa-4d6a-adfe-237c479e59ff+14:14443:x1876445617051648:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789518236.725110:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7822d6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.725126:0:15115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7822d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.725137:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7822d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.725538:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c7822dd lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.725551:0:15115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7822ac lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc3e expref: 15 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.725559:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c7822dd lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.725592:0:15115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7822ac lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc3e expref: 15 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.725641:0:15115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7822ac lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc3e expref: 15 pid: 14409 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518236.725654:0:15115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6502d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15115:1876445627504896:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518236.725741:0:15115:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffdfffb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518236.733398:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518236.733482:0:15115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6502d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15115:1876445627504896:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518236.733517:0:15115:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c7822dd lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518236.733582:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617051776 00000100:00100000:3.0:1789518236.733590:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617051776 00010000:00010000:3.0:1789518236.733655:0:14395:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7822ac lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc3e expref: 16 pid: 14409 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518236.733676:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:3.0:1789518236.733682:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+16:2343:x1876445617051776:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518236.733692:0:14395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518236.733696:0:14395:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7822ac lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc3e expref: 16 pid: 14409 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.733704:0:14395:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7822ac lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc3e expref: 16 pid: 14409 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.733719:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c7822ac lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc3e expref: 16 pid: 14409 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.733730:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99ffd2a17f00) 00010000:00010000:3.0:1789518236.733733:0:14395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c7822dd lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.733753:0:14395:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c7822dd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.733758:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c7822dd lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.733776:0:14395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518236.733821:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+15:2343:x1876445617051776:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 139us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518236.733826:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00010000:00010000:2.0:1789518236.733955:0:15115:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c7822dd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.733963:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c7822dd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789518236.734131:0:15115:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1789518236.734276:0:15115:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1789518236.734323:0:15115:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1789518236.734396:0:15115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7881880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15115:1876445627505024:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789518236.734476:0:15115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518236.734562:0:15115:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffdb558540 going to sleep for 11 seconds 00000100:00100000:0.0:1789518236.734638:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627505024 00000100:00100000:0.0:1789518236.734644:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627505024 00000100:00100000:0.0:1789518236.734679:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789518236.734686:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15115:x1876445627505024:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789518236.734750:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15115:x1876445627505024:12345-0@lo:1000:mdt00_003.0 Request processed in 64us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518236.734756:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789518236.735279:0:15115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7881880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15115:1876445627505024:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1789518236.735946:0:15115:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1789518236.736008:0:15115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7881880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15115:1876445627505152:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789518236.736048:0:15115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518236.736078:0:15115:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbe900 going to sleep for 11 seconds 00000100:00100000:3.0:1789518236.736194:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627505152 00000100:00100000:3.0:1789518236.736198:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627505152 00000100:00100000:3.0:1789518236.736230:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789518236.736236:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15115:x1876445627505152:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789518236.736381:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:15115:x1876445627505152:12345-0@lo:1000:mdt00_003.0 Request processed in 144us (331us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789518236.736388:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789518236.736700:0:15115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7881880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15115:1876445627505152:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1789518236.736730:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c7822dd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.736740:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c7822dd lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.736748:0:15115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c7822dd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.736753:0:15115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518236.736758:0:15115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c7822dd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.736766:0:15115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c7822dd lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.736780:0:15115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99ffd2a17f00) 00010000:00010000:2.0:1789518236.736783:0:15115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518236.736788:0:15115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c7822dd lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.736793:0:15115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c7822dd lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.736826:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78223c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.736885:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78223c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.736891:0:15115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78223c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.736896:0:15115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518236.736899:0:15115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78223c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.736906:0:15115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78223c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.736914:0:15115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffd2a17700) 00010000:00010000:2.0:1789518236.736917:0:15115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518236.736923:0:15115:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8000/0x631fd8698c782243 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc22 expref: 18 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.736933:0:15115:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8000/0x631fd8698c782243 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc22 expref: 18 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.736941:0:15115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8000/0x631fd8698c782243 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc22 expref: 18 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.736986:0:15115:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29c8000/0x631fd8698c782243 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc22 expref: 18 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518236.736997:0:15115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7882680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15115:1876445627505280:192.168.206.51@tcp:105: 00000100:00100000:2.0:1789518236.737096:0:15115:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbe000 going to sleep for 11 seconds 00000100:00100000:2.0:1789518236.739445:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518236.739541:0:15115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7882680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15115:1876445627505280:192.168.206.51@tcp:105: 00010000:00010000:0.0:1789518236.739565:0:15115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78223c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.739574:0:15115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78223c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.739603:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c7822e4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.739667:0:15115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c7822e4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.739677:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c7822e4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.739687:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c7822e4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.739693:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c7822e4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.739699:0:15115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c7822e4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.739704:0:15115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518236.739707:0:15115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c7822e4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.739714:0:15115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c7822e4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.739724:0:15115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffd2a17700) 00010000:00010000:0.0:1789518236.739727:0:15115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518236.739730:0:15115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c7822e4 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.739741:0:15115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c7822e4 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.739756:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7822d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.739768:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7822d6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.739774:0:15115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7822d6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.739779:0:15115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518236.739783:0:15115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7822d6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.739788:0:15115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7822d6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.739797:0:15115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffd2a17700) 00010000:00010000:0.0:1789518236.739799:0:15115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789518236.739802:0:15115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7822d6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.739808:0:15115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7822d6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518236.740002:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa777a5b-38aa-4d6a-adfe-237c479e59ff+18:14443:x1876445617051648:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 14962us (15111us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1789518236.740012:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 52 00000020:00080000:0.0:1789518236.740017:0:15115:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789518236.740192:0:14443:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789518236.740197:0:14443:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518236.740236:0:14443:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789518236.740242:0:14443:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789518236.740998:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617051904 00000100:00100000:1.0:1789518236.741006:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617051904 00000100:00100000:1.0:1789518236.741084:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:1.0:1789518236.741094:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd80c7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+18:14442:x1876445617051904:12345-192.168.206.51@tcp:49:dd.0 00000100:00100000:1.0:1789518236.741195:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd80c7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa777a5b-38aa-4d6a-adfe-237c479e59ff+18:14442:x1876445617051904:12345-192.168.206.51@tcp:49:dd.0 Request processed in 102us (1757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518236.741214:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:2.0:1789518236.742567:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518236.742654:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617052160 00000100:00100000:1.0:1789518236.742662:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617052160 00000100:00100000:1.0:1789518236.742699:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:1.0:1789518236.742708:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+18:14443:x1876445617052160:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789518236.743991:0:14413:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789518236.744165:0:14413:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1789518236.744211:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7822eb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.744228:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7822eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.744239:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7822eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.744248:0:14413:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7822eb lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.744254:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7822eb lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.744261:0:14413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7822eb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.744335:0:14413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789518236.744438:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+20:14443:x1876445617052160:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 1727us (1873us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1789518236.744447:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00000020:00080000:1.0:1789518236.744459:0:14413:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789518236.744995:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518236.745003:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7822eb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.745011:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518236.745016:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7822eb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.745025:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7822eb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.745038:0:14399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99ffd2a17f00) 00010000:00010000:3.0:1789518236.745048:0:14399:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789518236.745053:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7822eb lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.745058:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7822eb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.745069:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518236.745070:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518236.745072:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518236.839324:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518236.839369:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518236.839468:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518236.840185:0:15098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617052288 00000100:00100000:2.0:1789518236.840195:0:15098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617052288 00000100:00100000:1.0:1789518236.840251:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617052416 00000100:00100000:1.0:1789518236.840257:0:15097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617052416 00000100:00100000:0.0:1789518236.840326:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617052544 00000100:00100000:0.0:1789518236.840331:0:15099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617052544 00000100:00100000:0.0:1789518236.840375:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:0.0:1789518236.840388:0:15099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa777a5b-38aa-4d6a-adfe-237c479e59ff+10:2343:x1876445617052288:12345-192.168.206.51@tcp:4:dd.0 00010000:00010000:0.0:1789518236.840436:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c7822f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.840456:0:15099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000017ddd459/0x631fd8698c7822c1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc4c expref: 10 pid: 15091 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.840469:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518236.840473:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518236.840477:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c7822f2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.840519:0:15099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000017ddd459/0x631fd8698c7822c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc4c expref: 10 pid: 15091 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.840536:0:15099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000017ddd459/0x631fd8698c7822c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc4c expref: 10 pid: 15091 timeout: 390 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518236.840552:0:15099:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6502d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:15099:1876445627505408:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518236.840664:0:15099:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffdfffb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518236.845374:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518236.845535:0:15099:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6502d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:15099:1876445627505408:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518236.845569:0:15099:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c7822f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518236.846212:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617052672 00000100:00100000:3.0:1789518236.846222:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617052672 00010000:00010000:3.0:1789518236.846268:0:14397:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000017ddd459/0x631fd8698c7822c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc4c expref: 11 pid: 15091 timeout: 390 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518236.846311:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:3.0:1789518236.846322:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7883800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa777a5b-38aa-4d6a-adfe-237c479e59ff+11:2343:x1876445617052672:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518236.846340:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518236.846369:0:14397:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000017ddd459/0x631fd8698c7822c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc4c expref: 11 pid: 15091 timeout: 390 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.846384:0:14397:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000017ddd459/0x631fd8698c7822c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc4c expref: 11 pid: 15091 timeout: 390 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.846413:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017ddd459/0x631fd8698c7822c1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc4c expref: 11 pid: 15091 timeout: 390 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.846527:0:14397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518236.846532:0:14397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518236.846539:0:14397:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c7822f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.846550:0:14397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c7822f2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.846667:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518236.846753:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7883800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa777a5b-38aa-4d6a-adfe-237c479e59ff+10:2343:x1876445617052672:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 431us (1392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518236.846762:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00010000:00010000:0.0:1789518236.847869:0:15099:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c7822f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518236.847908:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c7822f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789518236.893266:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:1.0:1789518236.893282:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:1.0:1789518236.893287:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:1.0:1789518236.893296:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:3.0:1789518236.893382:0:15099:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:3.0:1789518236.893386:0:15099:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1789518236 -> 1789518237 00002000:00010000:3.0:1789518236.893389:0:15099:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:3.0:1789518236.893403:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c7822f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.893415:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c7822f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.893424:0:15099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c7822f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.893431:0:15099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518236.893436:0:15099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c7822f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.893456:0:15099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c7822f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.893475:0:15099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c7822f2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.893483:0:15099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c7822f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518236.893607:0:15099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa777a5b-38aa-4d6a-adfe-237c479e59ff+7:2343:x1876445617052288:12345-192.168.206.51@tcp:4:dd.0 Request processed in 53215us (54285us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1789518236.893660:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:3.0:1789518236.893689:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:3.0:1789518236.893701:0:15099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa777a5b-38aa-4d6a-adfe-237c479e59ff+6:2343:x1876445617052416:12345-192.168.206.51@tcp:4:dd.0 00002000:00010000:3.0:1789518236.893735:0:15099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 1048576, mtime: 0x6aa9e19d, atime: 0x6aa9e19c, ctime: 0x0, blocks: 0x803 00010000:00010000:3.0:1789518236.893742:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000919be93c/0x631fd8698c7822f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.893752:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=290s v=(0 0) 00010000:00010000:3.0:1789518236.893756:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518236.893762:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000919be93c/0x631fd8698c7822f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518236.893774:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000919be93c/0x631fd8698c7822f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789518236.931107:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:1.0:1789518236.931263:0:15099:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:1.0:1789518236.931268:0:15099:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:1.0:1789518236.931283:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000919be93c/0x631fd8698c7822f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.931297:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000919be93c/0x631fd8698c7822f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.931306:0:15099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000919be93c/0x631fd8698c7822f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.931312:0:15099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518236.931317:0:15099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000919be93c/0x631fd8698c7822f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.931326:0:15099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000919be93c/0x631fd8698c7822f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.931344:0:15099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000919be93c/0x631fd8698c7822f9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.931352:0:15099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000919be93c/0x631fd8698c7822f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518236.931454:0:15099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa777a5b-38aa-4d6a-adfe-237c479e59ff+6:2343:x1876445617052416:12345-192.168.206.51@tcp:4:dd.0 Request processed in 37753us (92081us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789518236.931465:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:1.0:1789518236.931498:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:1.0:1789518236.931525:0:15099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa777a5b-38aa-4d6a-adfe-237c479e59ff+5:2342:x1876445617052544:12345-192.168.206.51@tcp:4:dd.0 00002000:00010000:1.0:1789518236.931566:0:15099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 2097152, mtime: 0x6aa9e19d, atime: 0x6aa9e19c, ctime: 0x0, blocks: 0x1007 00010000:00010000:1.0:1789518236.931572:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044e0d026/0x631fd8698c782300 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.931584:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=290s v=(0 0) 00010000:00010000:1.0:1789518236.931589:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518236.931594:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044e0d026/0x631fd8698c782300 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.931606:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044e0d026/0x631fd8698c782300 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789518236.974144:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:1.0:1789518236.974308:0:15099:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:1.0:1789518236.974313:0:15099:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:1.0:1789518236.974334:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044e0d026/0x631fd8698c782300 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.974347:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044e0d026/0x631fd8698c782300 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.974376:0:15099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044e0d026/0x631fd8698c782300 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.974383:0:15099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518236.974388:0:15099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044e0d026/0x631fd8698c782300 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.974396:0:15099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044e0d026/0x631fd8698c782300 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.974415:0:15099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044e0d026/0x631fd8698c782300 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518236.974422:0:15099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044e0d026/0x631fd8698c782300 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518236.974706:0:15099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa777a5b-38aa-4d6a-adfe-237c479e59ff+5:2342:x1876445617052544:12345-192.168.206.51@tcp:4:dd.0 Request processed in 43195us (135232us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1789518236.974717:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:0.0:1789518236.983397:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518236.983440:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518236.983549:0:15098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617052800 00000100:00100000:2.0:1789518236.983558:0:15098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617052800 00000100:00100000:1.0:1789518236.983589:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617052928 00000100:00100000:1.0:1789518236.983596:0:15097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617052928 00000100:00100000:2.0:1789518236.983650:0:15098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:2.0:1789518236.983663:0:15098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+6:2343:x1876445617052800:12345-192.168.206.51@tcp:4:dd.0 00002000:00010000:2.0:1789518236.983714:0:15098:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6aa9e19d, atime: 0x6aa9e19c, ctime: 0x0, blocks: 0x1807 00010000:00010000:2.0:1789518236.983723:0:15098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040d4af35/0x631fd8698c782307 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.983738:0:15098:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=290s v=(0 0) 00010000:00010000:2.0:1789518236.983742:0:15098:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518236.983749:0:15098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040d4af35/0x631fd8698c782307 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.983763:0:15098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040d4af35/0x631fd8698c782307 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518236.987807:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518236.987846:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518236.987930:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518236.988037:0:15099:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789518236.988048:0:15099:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1789518236.988438:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617053056 00000100:00100000:2.0:1789518236.988447:0:15099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617053056 00000100:00100000:2.0:1789518236.988493:0:15099:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1789518236.988499:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617053312 00000100:00100000:2.0:1789518236.988501:0:15099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617053312 00000100:00100000:2.0:1789518236.988530:0:15099:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1789518236.988535:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617053184 00000100:00100000:2.0:1789518236.988537:0:15099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617053184 00000100:00100000:2.0:1789518236.990433:0:16631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:2.0:1789518236.990448:0:16631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6500380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:aa777a5b-38aa-4d6a-adfe-237c479e59ff+10:2343:x1876445617052928:12345-192.168.206.51@tcp:4:dd.0 00010000:00010000:2.0:1789518236.990482:0:16631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000df0eeec/0x631fd8698c78230e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.990498:0:16631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518236.990515:0:16631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518236.990522:0:16631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000df0eeec/0x631fd8698c78230e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518236.990536:0:16631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000df0eeec/0x631fd8698c78230e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789518237.019385:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:2.0:1789518237.019416:0:15098:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 5242880 00002000:00010000:2.0:1789518237.019422:0:15098:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1789518237 00002000:00010000:2.0:1789518237.019425:0:15098:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:2.0:1789518237.019457:0:15098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040d4af35/0x631fd8698c782307 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518237.019485:0:15098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040d4af35/0x631fd8698c782307 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518237.019498:0:15098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040d4af35/0x631fd8698c782307 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518237.019516:0:15098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29c9200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518237.019521:0:15098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040d4af35/0x631fd8698c782307 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518237.019531:0:15098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040d4af35/0x631fd8698c782307 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518237.019553:0:15098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040d4af35/0x631fd8698c782307 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518237.019561:0:15098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040d4af35/0x631fd8698c782307 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518237.019712:0:15098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+12:2343:x1876445617052800:12345-192.168.206.51@tcp:4:dd.0 Request processed in 36048us (36320us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1789518237.019723:0:15098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:2.0:1789518237.019766:0:15098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:2.0:1789518237.019785:0:15098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+11:2343:x1876445617053056:12345-192.168.206.51@tcp:4:dd.0 00010000:00010000:2.0:1789518237.019819:0:15098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017ddd459/0x631fd8698c782315 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518237.019833:0:15098:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789518237.019837:0:15098:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518237.019844:0:15098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017ddd459/0x631fd8698c782315 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518237.019855:0:15098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017ddd459/0x631fd8698c782315 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789518237.020715:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1789518237.046194:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:1.0:1789518237.046262:0:16631:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:1.0:1789518237.046266:0:16631:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:1.0:1789518237.046279:0:16631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000df0eeec/0x631fd8698c78230e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518237.046302:0:16631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000df0eeec/0x631fd8698c78230e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518237.046310:0:16631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000df0eeec/0x631fd8698c78230e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518237.046316:0:16631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29c8800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518237.046320:0:16631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000df0eeec/0x631fd8698c78230e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518237.046329:0:16631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000df0eeec/0x631fd8698c78230e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518237.046349:0:16631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000df0eeec/0x631fd8698c78230e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518237.046357:0:16631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000df0eeec/0x631fd8698c78230e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518237.046446:0:16631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6500380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:aa777a5b-38aa-4d6a-adfe-237c479e59ff+11:2343:x1876445617052928:12345-192.168.206.51@tcp:4:dd.0 Request processed in 55999us (63001us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1789518237.046456:0:16631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:1.0:1789518237.046484:0:16631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:1.0:1789518237.046494:0:16631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:aa777a5b-38aa-4d6a-adfe-237c479e59ff+10:2343:x1876445617053312:12345-192.168.206.51@tcp:4:dd.0 00010000:00010000:1.0:1789518237.046537:0:16631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d063c167/0x631fd8698c78231c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518237.046867:0:16631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518237.046872:0:16631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518237.046878:0:16631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d063c167/0x631fd8698c78231c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518237.046888:0:16631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d063c167/0x631fd8698c78231c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789518237.072601:0:15098:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:1.0:1789518237.072609:0:15098:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:1.0:1789518237.072638:0:15098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017ddd459/0x631fd8698c782315 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518237.072651:0:15098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017ddd459/0x631fd8698c782315 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518237.072660:0:15098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017ddd459/0x631fd8698c782315 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518237.072667:0:15098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29c9e00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518237.072672:0:15098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017ddd459/0x631fd8698c782315 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518237.072680:0:15098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017ddd459/0x631fd8698c782315 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518237.072713:0:15098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017ddd459/0x631fd8698c782315 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518237.072721:0:15098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017ddd459/0x631fd8698c782315 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518237.073233:0:15098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+12:2343:x1876445617053056:12345-192.168.206.51@tcp:4:dd.0 Request processed in 53454us (85430us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1789518237.073243:0:15098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:1.0:1789518237.073272:0:15098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:1.0:1789518237.073283:0:15098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7883100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+11:2342:x1876445617053184:12345-192.168.206.51@tcp:4:dd.0 00010000:00010000:1.0:1789518237.073313:0:15098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c782323 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518237.073326:0:15098:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518237.073330:0:15098:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518237.073336:0:15098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c782323 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518237.073347:0:15098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c782323 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789518237.074709:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00000001:00080000:1.0:1789518237.099162:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:2.0:1789518237.099576:0:16631:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:2.0:1789518237.099593:0:16631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d063c167/0x631fd8698c78231c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518237.099606:0:16631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d063c167/0x631fd8698c78231c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518237.099635:0:16631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d063c167/0x631fd8698c78231c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518237.099643:0:16631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518237.099647:0:16631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d063c167/0x631fd8698c78231c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518237.099656:0:16631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d063c167/0x631fd8698c78231c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518237.099684:0:16631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d063c167/0x631fd8698c78231c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518237.099692:0:16631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d063c167/0x631fd8698c78231c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518237.099776:0:16631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:aa777a5b-38aa-4d6a-adfe-237c479e59ff+9:2343:x1876445617053312:12345-192.168.206.51@tcp:4:dd.0 Request processed in 53280us (111925us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1789518237.099786:0:16631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00000001:00080000:0.0:1789518237.123443:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00002000:00010000:1.0:1789518237.123730:0:15098:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1789518237.123756:0:15098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c782323 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518237.123869:0:15098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c782323 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518237.123878:0:15098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c782323 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518237.123885:0:15098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518237.123890:0:15098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c782323 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518237.123900:0:15098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c782323 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518237.123919:0:15098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c782323 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518237.123927:0:15098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c782323 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518237.124021:0:15098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7883100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aa777a5b-38aa-4d6a-adfe-237c479e59ff+5:2342:x1876445617053184:12345-192.168.206.51@tcp:4:dd.0 Request processed in 50736us (136085us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1789518237.124030:0:15098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00010000:00010000:0.0:1789518237.427144:0:16516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789518238.005662:0:16668:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1789518238.450813:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518238.834950:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627505664:0@lo:400:kworker.0 00000100:00100000:0.0:1789518238.834951:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a262dbd-f283-43e3-b7fd-ac44d37658cb:3281:1876445627505536:0@lo:400:kworker.0 00000100:00100000:1.0:1789518238.835050:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627505920:0@lo:400:kworker.0 00000100:00100000:0.0:1789518238.835462:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518238.835466:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518238.835532:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627506048:0@lo:400:kworker.0 00000100:00100000:0.0:1789518238.835563:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518238.835593:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627505536 00000100:00100000:0.0:1789518238.835600:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627505536 00000100:00100000:2.0:1789518238.835652:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627506176:0@lo:400:kworker.0 00000100:00100000:0.0:1789518238.835668:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789518238.835676:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+19:3281:x1876445627505536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518238.835684:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518238.835713:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518238.835721:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627505792:0@lo:400:kworker.0 00000100:00100000:0.0:1789518238.835734:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a262dbd-f283-43e3-b7fd-ac44d37658cb+19:3281:x1876445627505536:12345-0@lo:400:kworker.0 Request processed in 57us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518238.835743:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789518238.835749:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518238.835755:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518238.835783:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627506048 00000100:00100000:0.0:1789518238.835787:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627506048 00000100:00100000:2.0:1789518238.835803:0:16281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627505664 00000100:00100000:2.0:1789518238.835809:0:16281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627505664 00000100:00100000:1.0:1789518238.835829:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627506176 00000100:00100000:0.0:1789518238.835830:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627505920 00000100:00100000:1.0:1789518238.835837:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627506176 00000100:00100000:0.0:1789518238.835837:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627505920 00000100:00100000:2.0:1789518238.835847:0:16281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627505792 00000100:00100000:2.0:1789518238.835852:0:16281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627505792 00000100:00100000:0.0:1789518238.835870:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789518238.835880:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627506048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518238.835882:0:16281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789518238.835893:0:16281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627505664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518238.835924:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627506048:12345-0@lo:400:kworker.0 Request processed in 45us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518238.835940:0:16281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627505664:12345-0@lo:400:kworker.0 Request processed in 48us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518238.835954:0:16281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789518238.835970:0:16281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789518238.835977:0:16281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627505792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518238.836008:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789518238.836011:0:16281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627505792:12345-0@lo:400:kworker.0 Request processed in 34us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518238.836017:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789518238.836021:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627505920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518238.836022:0:16281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789518238.836045:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789518238.836051:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876445627506176:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789518238.836058:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789518238.836063:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789518238.836067:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518238.836087:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876445627506176:12345-0@lo:400:kworker.0 Request processed in 35us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518238.836093:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789518238.836098:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1789518238.836104:0:3282:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fff4000000, transno 8589934595 00000004:00080000:2.0:1789518238.836118:0:3282:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1789518238.836127:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627505920:12345-0@lo:400:kworker.0 Request processed in 109us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518238.836135:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789518238.836139:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627505792:0@lo:400:kworker.0 00000100:00100000:1.0:1789518238.836171:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627505920:0@lo:400:kworker.0 00000100:00100000:0.0:1789518238.836193:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a262dbd-f283-43e3-b7fd-ac44d37658cb:3281:1876445627505536:0@lo:400:kworker.0 00000100:00100000:0.0:1789518238.836207:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627506048:0@lo:400:kworker.0 00000100:00100000:2.0:1789518238.836856:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627505664:0@lo:400:kworker.0 00000100:00100000:2.0:1789518238.836871:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627506176:0@lo:400:kworker.0 00000100:00100000:2.0:1789518238.836891:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518238.836900:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6502300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627506304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518238.836936:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518238.836968:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627506304 00000100:00100000:3.0:1789518238.836974:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627506304 00000100:00100000:3.0:1789518238.837013:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789518238.837024:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627506304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789518238.837053:0:15095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1789518238.837275:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627506304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 255us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518238.837282:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789518238.837344:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6502300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627506304:0@lo:13:osp-pre-1-0.0 Debug log: 27399 lines, 27399 kept, 0 dropped, 0 bad.